2023-11-12 00:53:14,593 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-12 00:53:14,842 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db 2023-11-12 00:53:14,858 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-12 00:53:14,858 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620, deleteOnExit=true 2023-11-12 00:53:14,859 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-12 00:53:14,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/test.cache.data in system properties and HBase conf 2023-11-12 00:53:14,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/hadoop.tmp.dir in system properties and HBase conf 2023-11-12 00:53:14,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/hadoop.log.dir in system properties and HBase conf 2023-11-12 00:53:14,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-12 00:53:14,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-12 00:53:14,861 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-12 00:53:14,984 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-12 00:53:15,388 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-12 00:53:15,394 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-12 00:53:15,394 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-12 00:53:15,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-12 00:53:15,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-12 00:53:15,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-12 00:53:15,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-12 00:53:15,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-12 00:53:15,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-12 00:53:15,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-12 00:53:15,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/nfs.dump.dir in system properties and HBase conf 2023-11-12 00:53:15,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/java.io.tmpdir in system properties and HBase conf 2023-11-12 00:53:15,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-12 00:53:15,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-12 00:53:15,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-12 00:53:16,041 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-12 00:53:16,046 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-12 00:53:16,342 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-12 00:53:16,511 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-12 00:53:16,525 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-12 00:53:16,559 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-12 00:53:16,594 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/java.io.tmpdir/Jetty_localhost_41231_hdfs____in3ggt/webapp 2023-11-12 00:53:16,754 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41231 2023-11-12 00:53:16,768 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-12 00:53:16,768 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-12 00:53:17,269 WARN [Listener at localhost/46713] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-12 00:53:17,378 WARN [Listener at localhost/46713] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-12 00:53:17,398 WARN [Listener at localhost/46713] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-12 00:53:17,406 INFO [Listener at localhost/46713] log.Slf4jLog(67): jetty-6.1.26 2023-11-12 00:53:17,412 INFO [Listener at localhost/46713] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/java.io.tmpdir/Jetty_localhost_40939_datanode____qpo0qy/webapp 2023-11-12 00:53:17,535 INFO [Listener at localhost/46713] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40939 2023-11-12 00:53:17,941 WARN [Listener at localhost/40343] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-12 00:53:18,457 DEBUG [Listener at localhost/40343] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db 2023-11-12 00:53:18,459 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x418f8f3d9bd96dd0: Processing first storage report for DS-7edade3a-a07b-4bf4-b8fe-39b536835056 from datanode c59e51a0-f0f3-499f-bf73-1f56e5d89255 2023-11-12 00:53:18,461 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x418f8f3d9bd96dd0: from storage DS-7edade3a-a07b-4bf4-b8fe-39b536835056 node DatanodeRegistration(127.0.0.1:39567, datanodeUuid=c59e51a0-f0f3-499f-bf73-1f56e5d89255, infoPort=36409, infoSecurePort=0, ipcPort=40343, storageInfo=lv=-57;cid=testClusterID;nsid=647413849;c=1699750396122), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-12 00:53:18,461 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x418f8f3d9bd96dd0: Processing first storage report for DS-faac0009-6c95-438f-9bfd-0762d94c7c64 from datanode c59e51a0-f0f3-499f-bf73-1f56e5d89255 2023-11-12 00:53:18,461 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x418f8f3d9bd96dd0: from storage DS-faac0009-6c95-438f-9bfd-0762d94c7c64 node DatanodeRegistration(127.0.0.1:39567, datanodeUuid=c59e51a0-f0f3-499f-bf73-1f56e5d89255, infoPort=36409, infoSecurePort=0, ipcPort=40343, storageInfo=lv=-57;cid=testClusterID;nsid=647413849;c=1699750396122), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-12 00:53:18,587 INFO [Listener at localhost/40343] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/zookeeper_0, clientPort=60532, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-12 00:53:18,604 INFO [Listener at localhost/40343] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60532 2023-11-12 00:53:18,616 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:18,618 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:19,302 INFO [Listener at localhost/40343] util.FSUtils(471): Created version file at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2 with version=8 2023-11-12 00:53:19,303 INFO [Listener at localhost/40343] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/hbase-staging 2023-11-12 00:53:19,602 INFO [Listener at localhost/40343] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-12 00:53:20,069 INFO [Listener at localhost/40343] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-12 00:53:20,100 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-12 00:53:20,101 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-12 00:53:20,101 INFO [Listener at localhost/40343] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-12 00:53:20,101 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-12 00:53:20,101 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-12 00:53:20,251 INFO [Listener at localhost/40343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-12 00:53:20,327 DEBUG [Listener at localhost/40343] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-12 00:53:20,433 INFO [Listener at localhost/40343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41743 2023-11-12 00:53:20,442 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:20,444 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:20,467 INFO [Listener at localhost/40343] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41743 connecting to ZooKeeper ensemble=127.0.0.1:60532 2023-11-12 00:53:20,510 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:417430x0, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-12 00:53:20,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41743-0x101d7c402010000 connected 2023-11-12 00:53:20,542 DEBUG [Listener at localhost/40343] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-12 00:53:20,543 DEBUG [Listener at localhost/40343] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-12 00:53:20,546 DEBUG [Listener at localhost/40343] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-12 00:53:20,554 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41743 2023-11-12 00:53:20,557 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41743 2023-11-12 00:53:20,557 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41743 2023-11-12 00:53:20,557 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41743 2023-11-12 00:53:20,558 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41743 2023-11-12 00:53:20,564 INFO [Listener at localhost/40343] master.HMaster(444): hbase.rootdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2, hbase.cluster.distributed=false 2023-11-12 00:53:20,630 INFO [Listener at localhost/40343] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-12 00:53:20,630 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-12 00:53:20,630 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-12 00:53:20,630 INFO [Listener at localhost/40343] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-12 00:53:20,630 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-12 00:53:20,630 INFO [Listener at localhost/40343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-12 00:53:20,635 INFO [Listener at localhost/40343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-12 00:53:20,638 INFO [Listener at localhost/40343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43681 2023-11-12 00:53:20,640 INFO [Listener at localhost/40343] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-12 00:53:20,647 DEBUG [Listener at localhost/40343] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-12 00:53:20,648 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:20,650 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:20,652 INFO [Listener at localhost/40343] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43681 connecting to ZooKeeper ensemble=127.0.0.1:60532 2023-11-12 00:53:20,656 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:436810x0, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-12 00:53:20,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43681-0x101d7c402010001 connected 2023-11-12 00:53:20,657 DEBUG [Listener at localhost/40343] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-12 00:53:20,658 DEBUG [Listener at localhost/40343] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-12 00:53:20,659 DEBUG [Listener at localhost/40343] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-12 00:53:20,659 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43681 2023-11-12 00:53:20,660 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43681 2023-11-12 00:53:20,663 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43681 2023-11-12 00:53:20,665 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43681 2023-11-12 00:53:20,665 DEBUG [Listener at localhost/40343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43681 2023-11-12 00:53:20,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:20,678 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-12 00:53:20,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:20,705 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-12 00:53:20,705 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-12 00:53:20,705 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:20,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-12 00:53:20,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41743,1699750399446 from backup master directory 2023-11-12 00:53:20,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-12 00:53:20,711 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:20,711 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-12 00:53:20,711 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-12 00:53:20,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:20,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-12 00:53:20,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-12 00:53:20,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/hbase.id with ID: cd86331a-3362-49e6-9b13-7c87d6723b02 2023-11-12 00:53:20,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:20,864 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:20,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1ba8a2cc to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:20,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11138173, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:20,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-12 00:53:20,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-12 00:53:20,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-12 00:53:20,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-12 00:53:20,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-12 00:53:20,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-12 00:53:20,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-12 00:53:21,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store-tmp 2023-11-12 00:53:21,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:21,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-12 00:53:21,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:53:21,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:53:21,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-12 00:53:21,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:53:21,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:53:21,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-12 00:53:21,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/WALs/jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:21,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41743%2C1699750399446, suffix=, logDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/WALs/jenkins-hbase4.apache.org,41743,1699750399446, archiveDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/oldWALs, maxLogs=10 2023-11-12 00:53:21,545 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39567,DS-7edade3a-a07b-4bf4-b8fe-39b536835056,DISK] 2023-11-12 00:53:21,553 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-12 00:53:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/WALs/jenkins-hbase4.apache.org,41743,1699750399446/jenkins-hbase4.apache.org%2C41743%2C1699750399446.1699750401486 2023-11-12 00:53:21,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39567,DS-7edade3a-a07b-4bf4-b8fe-39b536835056,DISK]] 2023-11-12 00:53:21,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:21,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:21,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-12 00:53:21,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-12 00:53:21,684 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-12 00:53:21,692 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-12 00:53:21,718 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-12 00:53:21,730 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:21,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-12 00:53:21,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-12 00:53:21,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-12 00:53:21,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:53:21,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73501153, jitterRate=0.09525252878665924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:53:21,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-12 00:53:21,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-12 00:53:21,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-12 00:53:21,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-12 00:53:21,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-12 00:53:21,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-12 00:53:21,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 34 msec 2023-11-12 00:53:21,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-12 00:53:21,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-12 00:53:21,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-12 00:53:21,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-12 00:53:21,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-12 00:53:21,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-12 00:53:21,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-12 00:53:21,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-12 00:53:21,900 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:21,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-12 00:53:21,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-12 00:53:21,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-12 00:53:21,921 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-12 00:53:21,921 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:21,921 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-12 00:53:21,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41743,1699750399446, sessionid=0x101d7c402010000, setting cluster-up flag (Was=false) 2023-11-12 00:53:21,942 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:21,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-12 00:53:21,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:21,955 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:21,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-12 00:53:21,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:21,965 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp 2023-11-12 00:53:21,970 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(951): ClusterId : cd86331a-3362-49e6-9b13-7c87d6723b02 2023-11-12 00:53:21,975 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-12 00:53:21,983 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-12 00:53:21,983 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-12 00:53:21,987 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-12 00:53:21,989 DEBUG [RS:0;jenkins-hbase4:43681] zookeeper.ReadOnlyZKClient(139): Connect 0x3d0e1bbd to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:21,993 DEBUG [RS:0;jenkins-hbase4:43681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33c9e26c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:21,994 DEBUG [RS:0;jenkins-hbase4:43681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f670cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-12 00:53:22,017 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43681 2023-11-12 00:53:22,021 INFO [RS:0;jenkins-hbase4:43681] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-12 00:53:22,022 INFO [RS:0;jenkins-hbase4:43681] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-12 00:53:22,022 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1022): About to register with Master. 2023-11-12 00:53:22,024 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41743,1699750399446 with isa=jenkins-hbase4.apache.org/172.31.14.131:43681, startcode=1699750400629 2023-11-12 00:53:22,040 DEBUG [RS:0;jenkins-hbase4:43681] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-12 00:53:22,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-12 00:53:22,105 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54953, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-12 00:53:22,113 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41743] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-11-12 00:53:22,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-12 00:53:22,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-12 00:53:22,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-12 00:53:22,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-12 00:53:22,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-12 00:53:22,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-12 00:53:22,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699750432117 2023-11-12 00:53:22,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-12 00:53:22,123 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-12 00:53:22,124 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-12 00:53:22,130 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-12 00:53:22,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-12 00:53:22,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-12 00:53:22,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-12 00:53:22,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-12 00:53:22,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-12 00:53:22,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-12 00:53:22,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-12 00:53:22,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-12 00:53:22,150 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(2830): Master is not running yet 2023-11-12 00:53:22,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-12 00:53:22,154 WARN [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-11-12 00:53:22,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-12 00:53:22,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699750402157,5,FailOnTimeoutGroup] 2023-11-12 00:53:22,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699750402157,5,FailOnTimeoutGroup] 2023-11-12 00:53:22,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-12 00:53:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,168 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:22,169 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:22,170 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2 2023-11-12 00:53:22,185 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:22,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-12 00:53:22,193 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/info 2023-11-12 00:53:22,194 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-12 00:53:22,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:22,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-12 00:53:22,198 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/rep_barrier 2023-11-12 00:53:22,199 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-12 00:53:22,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:22,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-12 00:53:22,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/table 2023-11-12 00:53:22,203 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-12 00:53:22,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:22,206 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740 2023-11-12 00:53:22,206 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740 2023-11-12 00:53:22,210 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-12 00:53:22,212 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-12 00:53:22,215 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:53:22,216 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60869636, jitterRate=-0.09297174215316772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-12 00:53:22,216 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-12 00:53:22,216 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-12 00:53:22,216 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-12 00:53:22,216 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-12 00:53:22,216 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-12 00:53:22,216 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-12 00:53:22,217 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-12 00:53:22,218 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-12 00:53:22,223 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-12 00:53:22,223 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-12 00:53:22,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-12 00:53:22,249 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-12 00:53:22,252 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-12 00:53:22,255 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41743,1699750399446 with isa=jenkins-hbase4.apache.org/172.31.14.131:43681, startcode=1699750400629 2023-11-12 00:53:22,262 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41743] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,270 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2 2023-11-12 00:53:22,270 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:46713 2023-11-12 00:53:22,270 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-12 00:53:22,277 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-12 00:53:22,278 DEBUG [RS:0;jenkins-hbase4:43681] zookeeper.ZKUtil(162): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,278 WARN [RS:0;jenkins-hbase4:43681] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-12 00:53:22,280 INFO [RS:0;jenkins-hbase4:43681] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-12 00:53:22,280 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1948): logDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/WALs/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,281 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43681,1699750400629] 2023-11-12 00:53:22,301 DEBUG [RS:0;jenkins-hbase4:43681] zookeeper.ZKUtil(162): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,315 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-12 00:53:22,324 INFO [RS:0;jenkins-hbase4:43681] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-12 00:53:22,344 INFO [RS:0;jenkins-hbase4:43681] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-12 00:53:22,348 INFO [RS:0;jenkins-hbase4:43681] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:53:22,349 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,350 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-12 00:53:22,358 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,358 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,358 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,359 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,360 DEBUG [RS:0;jenkins-hbase4:43681] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-12 00:53:22,360 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,361 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,361 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,380 INFO [RS:0;jenkins-hbase4:43681] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-12 00:53:22,383 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43681,1699750400629-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,404 INFO [RS:0;jenkins-hbase4:43681] regionserver.Replication(203): jenkins-hbase4.apache.org,43681,1699750400629 started 2023-11-12 00:53:22,405 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43681,1699750400629, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43681, sessionid=0x101d7c402010001 2023-11-12 00:53:22,405 DEBUG [jenkins-hbase4:41743] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-12 00:53:22,405 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-12 00:53:22,406 DEBUG [RS:0;jenkins-hbase4:43681] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,406 DEBUG [RS:0;jenkins-hbase4:43681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43681,1699750400629' 2023-11-12 00:53:22,406 DEBUG [RS:0;jenkins-hbase4:43681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:22,407 DEBUG [RS:0;jenkins-hbase4:43681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:22,407 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43681,1699750400629, state=OPENING 2023-11-12 00:53:22,408 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-12 00:53:22,408 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-12 00:53:22,408 DEBUG [RS:0;jenkins-hbase4:43681] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,408 DEBUG [RS:0;jenkins-hbase4:43681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43681,1699750400629' 2023-11-12 00:53:22,408 DEBUG [RS:0;jenkins-hbase4:43681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-12 00:53:22,409 DEBUG [RS:0;jenkins-hbase4:43681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-12 00:53:22,410 DEBUG [RS:0;jenkins-hbase4:43681] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-12 00:53:22,410 INFO [RS:0;jenkins-hbase4:43681] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-12 00:53:22,410 INFO [RS:0;jenkins-hbase4:43681] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-12 00:53:22,415 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-12 00:53:22,418 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:22,418 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-12 00:53:22,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:22,523 INFO [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43681%2C1699750400629, suffix=, logDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/WALs/jenkins-hbase4.apache.org,43681,1699750400629, archiveDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/oldWALs, maxLogs=32 2023-11-12 00:53:22,551 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39567,DS-7edade3a-a07b-4bf4-b8fe-39b536835056,DISK] 2023-11-12 00:53:22,555 INFO [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/WALs/jenkins-hbase4.apache.org,43681,1699750400629/jenkins-hbase4.apache.org%2C43681%2C1699750400629.1699750402527 2023-11-12 00:53:22,555 DEBUG [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39567,DS-7edade3a-a07b-4bf4-b8fe-39b536835056,DISK]] 2023-11-12 00:53:22,611 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:22,614 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-12 00:53:22,617 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-12 00:53:22,628 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-12 00:53:22,628 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-12 00:53:22,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43681%2C1699750400629.meta, suffix=.meta, logDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/WALs/jenkins-hbase4.apache.org,43681,1699750400629, archiveDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/oldWALs, maxLogs=32 2023-11-12 00:53:22,647 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39567,DS-7edade3a-a07b-4bf4-b8fe-39b536835056,DISK] 2023-11-12 00:53:22,651 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/WALs/jenkins-hbase4.apache.org,43681,1699750400629/jenkins-hbase4.apache.org%2C43681%2C1699750400629.meta.1699750402632.meta 2023-11-12 00:53:22,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39567,DS-7edade3a-a07b-4bf4-b8fe-39b536835056,DISK]] 2023-11-12 00:53:22,651 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:22,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-12 00:53:22,671 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-12 00:53:22,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-12 00:53:22,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-12 00:53:22,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:22,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-12 00:53:22,681 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-12 00:53:22,684 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-12 00:53:22,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/info 2023-11-12 00:53:22,685 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/info 2023-11-12 00:53:22,686 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-12 00:53:22,687 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:22,687 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-12 00:53:22,688 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/rep_barrier 2023-11-12 00:53:22,688 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/rep_barrier 2023-11-12 00:53:22,689 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-12 00:53:22,689 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:22,690 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-12 00:53:22,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/table 2023-11-12 00:53:22,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/table 2023-11-12 00:53:22,691 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-12 00:53:22,692 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:22,694 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740 2023-11-12 00:53:22,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740 2023-11-12 00:53:22,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-12 00:53:22,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-12 00:53:22,703 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63338494, jitterRate=-0.05618289113044739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-12 00:53:22,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-12 00:53:22,713 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699750402604 2023-11-12 00:53:22,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-12 00:53:22,733 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-12 00:53:22,734 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43681,1699750400629, state=OPEN 2023-11-12 00:53:22,740 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-12 00:53:22,740 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-12 00:53:22,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-12 00:53:22,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43681,1699750400629 in 318 msec 2023-11-12 00:53:22,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-12 00:53:22,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 514 msec 2023-11-12 00:53:22,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 736 msec 2023-11-12 00:53:22,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699750402759, completionTime=-1 2023-11-12 00:53:22,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-12 00:53:22,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-12 00:53:22,836 DEBUG [hconnection-0x53acf59e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:53:22,839 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:53:22,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-12 00:53:22,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699750462856 2023-11-12 00:53:22,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699750522856 2023-11-12 00:53:22,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 96 msec 2023-11-12 00:53:22,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41743,1699750399446-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41743,1699750399446-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41743,1699750399446-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41743, period=300000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-12 00:53:22,886 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-12 00:53:22,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-12 00:53:22,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-12 00:53:22,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-12 00:53:22,907 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:53:22,909 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:53:22,930 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:22,932 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af empty. 2023-11-12 00:53:22,933 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:22,933 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-12 00:53:22,954 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:22,957 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3ca8350d46be6df0d4769861a6ebe5af, NAME => 'hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:53:22,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:22,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3ca8350d46be6df0d4769861a6ebe5af, disabling compactions & flushes 2023-11-12 00:53:22,968 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:22,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:22,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. after waiting 0 ms 2023-11-12 00:53:22,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:22,968 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:22,968 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3ca8350d46be6df0d4769861a6ebe5af: 2023-11-12 00:53:22,973 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:53:22,988 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699750402977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750402977"}]},"ts":"1699750402977"} 2023-11-12 00:53:23,017 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:53:23,020 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:53:23,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750403020"}]},"ts":"1699750403020"} 2023-11-12 00:53:23,028 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-12 00:53:23,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3ca8350d46be6df0d4769861a6ebe5af, ASSIGN}] 2023-11-12 00:53:23,038 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3ca8350d46be6df0d4769861a6ebe5af, ASSIGN 2023-11-12 00:53:23,040 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3ca8350d46be6df0d4769861a6ebe5af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:53:23,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3ca8350d46be6df0d4769861a6ebe5af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:23,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699750403191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750403191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750403191"}]},"ts":"1699750403191"} 2023-11-12 00:53:23,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3ca8350d46be6df0d4769861a6ebe5af, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:23,349 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:23,357 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:23,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ca8350d46be6df0d4769861a6ebe5af, NAME => 'hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:23,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:23,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,360 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,366 INFO [StoreOpener-3ca8350d46be6df0d4769861a6ebe5af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,368 DEBUG [StoreOpener-3ca8350d46be6df0d4769861a6ebe5af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/info 2023-11-12 00:53:23,368 DEBUG [StoreOpener-3ca8350d46be6df0d4769861a6ebe5af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/info 2023-11-12 00:53:23,369 INFO [StoreOpener-3ca8350d46be6df0d4769861a6ebe5af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ca8350d46be6df0d4769861a6ebe5af columnFamilyName info 2023-11-12 00:53:23,370 INFO [StoreOpener-3ca8350d46be6df0d4769861a6ebe5af-1] regionserver.HStore(310): Store=3ca8350d46be6df0d4769861a6ebe5af/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:23,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,377 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:53:23,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:53:23,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3ca8350d46be6df0d4769861a6ebe5af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71057060, jitterRate=0.05883270502090454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:53:23,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3ca8350d46be6df0d4769861a6ebe5af: 2023-11-12 00:53:23,384 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af., pid=6, masterSystemTime=1699750403349 2023-11-12 00:53:23,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:23,389 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:53:23,391 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3ca8350d46be6df0d4769861a6ebe5af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:23,391 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699750403390"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750403390"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750403390"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750403390"}]},"ts":"1699750403390"} 2023-11-12 00:53:23,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-12 00:53:23,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3ca8350d46be6df0d4769861a6ebe5af, server=jenkins-hbase4.apache.org,43681,1699750400629 in 200 msec 2023-11-12 00:53:23,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-12 00:53:23,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3ca8350d46be6df0d4769861a6ebe5af, ASSIGN in 365 msec 2023-11-12 00:53:23,406 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:53:23,407 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750403406"}]},"ts":"1699750403406"} 2023-11-12 00:53:23,410 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-12 00:53:23,414 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:53:23,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 518 msec 2023-11-12 00:53:23,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-12 00:53:23,510 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-12 00:53:23,510 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:53:23,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-12 00:53:23,563 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-12 00:53:23,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-11-12 00:53:23,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-12 00:53:23,593 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-12 00:53:23,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-11-12 00:53:23,618 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-12 00:53:23,621 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-12 00:53:23,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.910sec 2023-11-12 00:53:23,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-12 00:53:23,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-12 00:53:23,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-12 00:53:23,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41743,1699750399446-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-12 00:53:23,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41743,1699750399446-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-12 00:53:23,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-12 00:53:23,676 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(139): Connect 0x42f95205 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:23,681 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd83e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:23,693 DEBUG [hconnection-0x18b1d570-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:53:23,706 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:53:23,716 INFO [Listener at localhost/40343] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:53:23,718 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(139): Connect 0x2131ff51 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:23,722 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37318dfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:23,722 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:53:23,779 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=172, AvailableMemoryMB=1550 2023-11-12 00:53:23,792 DEBUG [Listener at localhost/40343] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:53:23,796 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:53:23,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-12 00:53:23,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:23,812 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:53:23,814 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:53:23,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-12 00:53:23,818 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:23,819 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb empty. 2023-11-12 00:53:23,821 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:23,821 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-12 00:53:23,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-12 00:53:23,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-12 00:53:24,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-12 00:53:24,241 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:24,243 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 35029a0c0c81d223a4e45d489958cfeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:53:24,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-12 00:53:24,656 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:24,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 35029a0c0c81d223a4e45d489958cfeb, disabling compactions & flushes 2023-11-12 00:53:24,657 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:24,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:24,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. after waiting 0 ms 2023-11-12 00:53:24,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:24,658 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:24,658 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:24,663 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:53:24,665 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750404665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750404665"}]},"ts":"1699750404665"} 2023-11-12 00:53:24,668 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:53:24,670 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:53:24,670 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750404670"}]},"ts":"1699750404670"} 2023-11-12 00:53:24,673 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-12 00:53:24,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, ASSIGN}] 2023-11-12 00:53:24,682 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, ASSIGN 2023-11-12 00:53:24,683 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:53:24,835 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=35029a0c0c81d223a4e45d489958cfeb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:24,835 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750404835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750404835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750404835"}]},"ts":"1699750404835"} 2023-11-12 00:53:24,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 35029a0c0c81d223a4e45d489958cfeb, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:24,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-12 00:53:24,993 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:24,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:25,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 35029a0c0c81d223a4e45d489958cfeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:25,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:25,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,004 INFO [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,007 DEBUG [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:25,007 DEBUG [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:25,011 INFO [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35029a0c0c81d223a4e45d489958cfeb columnFamilyName family1 2023-11-12 00:53:25,014 INFO [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] regionserver.HStore(310): Store=35029a0c0c81d223a4e45d489958cfeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:25,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:25,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:53:25,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 35029a0c0c81d223a4e45d489958cfeb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59206710, jitterRate=-0.11775127053260803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:53:25,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:25,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., pid=11, masterSystemTime=1699750404993 2023-11-12 00:53:25,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:25,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:25,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=35029a0c0c81d223a4e45d489958cfeb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:25,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750405037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750405037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750405037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750405037"}]},"ts":"1699750405037"} 2023-11-12 00:53:25,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-12 00:53:25,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 35029a0c0c81d223a4e45d489958cfeb, server=jenkins-hbase4.apache.org,43681,1699750400629 in 202 msec 2023-11-12 00:53:25,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-12 00:53:25,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, ASSIGN in 366 msec 2023-11-12 00:53:25,050 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:53:25,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750405050"}]},"ts":"1699750405050"} 2023-11-12 00:53:25,053 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-12 00:53:25,056 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:53:25,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2470 sec 2023-11-12 00:53:25,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-12 00:53:25,944 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-12 00:53:25,961 DEBUG [hconnection-0x236d8801-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:53:25,964 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:53:26,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:26,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,126 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:26,126 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:26,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:26,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:26,128 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,128 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,129 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:26,130 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:26,130 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,130 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,132 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,134 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:26,135 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:26,135 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:26,136 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:26,136 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:26,136 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:26,136 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:26,137 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:53:26,703 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130442d63e6e6dc40088f8e0b9f9b552fa1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130442d63e6e6dc40088f8e0b9f9b552fa1 2023-11-12 00:53:26,724 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/3f9130007fc9442da6df5e2901596b07 2023-11-12 00:53:26,735 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/3f9130007fc9442da6df5e2901596b07 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/3f9130007fc9442da6df5e2901596b07 2023-11-12 00:53:26,744 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/3f9130007fc9442da6df5e2901596b07, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-12 00:53:26,748 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 611ms, sequenceid=5, compaction requested=false 2023-11-12 00:53:26,749 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:26,752 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:26,753 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:26,758 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,758 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:26,759 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,759 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:26,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5067af5c[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:26,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,764 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,764 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:26,764 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:26,764 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:26,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,765 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:26,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:26,768 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:26,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:26,778 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:26,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:26,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:26,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:26,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,779 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:26,783 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,783 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,783 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:26,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:26,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:26,784 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:26,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:26,787 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,800 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,800 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:26,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:26,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:26,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:26,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:26,803 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:26,803 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:26,903 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:26,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:26,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:26,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:26,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,922 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:26,922 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:26,922 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:26,922 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:26,923 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,923 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,930 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:26,930 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:26,931 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:26,931 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:26,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:26,933 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:26,933 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:26,933 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:26,933 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:26,933 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:26,933 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:26,933 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:26,934 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:53:27,361 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285fa9964307744f6b903f3dd881ca89b4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285fa9964307744f6b903f3dd881ca89b4 2023-11-12 00:53:27,773 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/d5d5428319cd4a0e98ac976e8d9cfdee 2023-11-12 00:53:27,787 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/d5d5428319cd4a0e98ac976e8d9cfdee as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/d5d5428319cd4a0e98ac976e8d9cfdee 2023-11-12 00:53:27,799 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/d5d5428319cd4a0e98ac976e8d9cfdee, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:53:27,801 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 867ms, sequenceid=9, compaction requested=false 2023-11-12 00:53:27,801 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:27,801 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:27,801 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:27,802 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:27,802 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,802 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:27,802 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:27,806 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:27,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:27,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:27,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cbf4d73[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:27,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:27,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,811 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,811 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:27,811 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:27,811 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:27,811 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:27,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:27,813 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:27,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:27,814 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:27,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:27,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:27,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:27,820 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:27,820 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:27,820 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:27,820 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,820 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:27,825 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,825 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,825 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:27,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:27,826 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,831 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:27,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,840 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:27,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:27,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,841 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:27,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:27,842 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:27,843 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:27,943 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:27,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:27,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:27,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:27,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,959 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:27,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:27,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:27,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:27,960 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,960 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,962 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:27,962 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:27,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:27,962 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:27,962 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:27,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:27,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,964 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,964 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:27,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:27,965 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:27,965 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:27,965 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:27,966 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:28,207 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:53:28,330 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-12 00:53:28,331 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-12 00:53:28,392 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201fb6e93969a4443f78f7193d908533466 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb6e93969a4443f78f7193d908533466 2023-11-12 00:53:28,805 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/df3426beeb254b0d89e45c2628155157 2023-11-12 00:53:28,814 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/df3426beeb254b0d89e45c2628155157 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/df3426beeb254b0d89e45c2628155157 2023-11-12 00:53:28,823 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/df3426beeb254b0d89e45c2628155157, entries=1, sequenceid=13, filesize=5.0 K 2023-11-12 00:53:28,824 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 858ms, sequenceid=13, compaction requested=true 2023-11-12 00:53:28,824 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:28,824 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:28,824 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:28,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:28,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:28,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:28,827 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,827 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:28,828 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,828 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:28,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:28,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:28,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:28,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:28,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e31a77[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:28,830 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:28,830 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,832 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:28,832 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,832 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:28,834 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:28,834 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,834 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:28,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:28,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:28,834 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:28,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:28,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:28,839 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:28,839 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:28,839 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:28,839 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,839 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:28,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:28,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:28,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:28,844 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,847 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:28,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:28,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:28,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,854 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:28,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:28,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:28,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:28,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:28,854 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:28,855 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:28,955 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:28,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:28,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:28,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:28,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,968 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:28,968 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:28,969 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:28,969 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:28,970 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,970 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,972 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,972 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:28,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:28,972 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:28,972 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:28,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:28,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,973 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,973 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:28,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:28,974 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:28,974 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:28,975 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:28,975 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:29,404 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120570a9d5ed8e344efe8fa641a14e360b74 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120570a9d5ed8e344efe8fa641a14e360b74 2023-11-12 00:53:29,598 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-12 00:53:29,599 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-12 00:53:29,823 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/e616b42920f545939dee39a14308beac 2023-11-12 00:53:29,832 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/e616b42920f545939dee39a14308beac as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/e616b42920f545939dee39a14308beac 2023-11-12 00:53:29,840 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/e616b42920f545939dee39a14308beac, entries=1, sequenceid=17, filesize=5.0 K 2023-11-12 00:53:29,841 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 866ms, sequenceid=17, compaction requested=true 2023-11-12 00:53:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:29,841 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:29,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:29,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:29,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:29,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,846 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:29,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:29,846 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,847 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:29,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:29,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6824dac1[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:29,849 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:29,849 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,851 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,851 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:29,851 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:29,851 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:29,851 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,851 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:29,853 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:29,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,853 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:29,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:29,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:29,853 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:29,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:29,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:29,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:29,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:29,857 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:29,857 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:29,857 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:29,857 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,857 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:29,867 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,867 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:29,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,867 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:29,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:29,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:29,868 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:29,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,870 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:29,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:29,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-12 00:53:29,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:29,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:29,875 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,875 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:29,876 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:29,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:29,976 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:29,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:29,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:29,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:29,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,991 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:29,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:29,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:29,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:29,992 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,992 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,995 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:29,995 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:29,996 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:29,996 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:29,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:29,997 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:29,997 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:30,013 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:30,013 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:30,013 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:30,013 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:30,013 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:30,035 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288919a757b17343208699c362609d6a99 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512288919a757b17343208699c362609d6a99 2023-11-12 00:53:30,450 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/250b3c2902c444de82498f2a999e1c8a 2023-11-12 00:53:30,458 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/250b3c2902c444de82498f2a999e1c8a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/250b3c2902c444de82498f2a999e1c8a 2023-11-12 00:53:30,466 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/250b3c2902c444de82498f2a999e1c8a, entries=1, sequenceid=21, filesize=5.0 K 2023-11-12 00:53:30,467 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 454ms, sequenceid=21, compaction requested=true 2023-11-12 00:53:30,467 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:30,467 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:30,467 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:30,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:30,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:30,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:30,471 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,471 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,472 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:30,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:30,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:30,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d495d6[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:30,474 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:30,474 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,475 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:30,476 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:30,476 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:30,476 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,476 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:30,477 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,477 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:30,477 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:30,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:30,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:30,477 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:30,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:30,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:30,481 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:30,481 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:30,481 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:30,481 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,481 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:30,483 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,483 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:30,483 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:30,484 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:30,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:30,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,486 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:30,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:30,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:30,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:30,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:30,490 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:30,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,491 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,491 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,491 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,491 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:30,491 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:30,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:30,592 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:30,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:30,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:30,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:30,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,604 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:30,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:30,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:30,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:30,605 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,605 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,607 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:30,607 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:30,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:30,608 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:30,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,608 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:30,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:30,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,609 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,609 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:30,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:30,610 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:30,610 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:30,610 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:30,610 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:30,610 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:30,610 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:30,611 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:30,634 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319ae3b0a88b414e1a893ce65b1e9403af to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512319ae3b0a88b414e1a893ce65b1e9403af 2023-11-12 00:53:31,044 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/0d7a7e5891a2431aab04d369925c759d 2023-11-12 00:53:31,053 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/0d7a7e5891a2431aab04d369925c759d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/0d7a7e5891a2431aab04d369925c759d 2023-11-12 00:53:31,061 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/0d7a7e5891a2431aab04d369925c759d, entries=1, sequenceid=25, filesize=5.0 K 2023-11-12 00:53:31,062 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 451ms, sequenceid=25, compaction requested=true 2023-11-12 00:53:31,062 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:31,062 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:31,062 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:31,063 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:31,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,066 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:31,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:31,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:31,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@434694ca[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:31,068 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:31,068 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,070 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:31,070 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,070 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:31,072 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:31,072 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,072 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:31,072 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:31,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:31,076 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:31,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:31,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:31,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,076 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:31,078 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,078 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:31,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,078 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:31,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:31,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:31,079 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:31,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,081 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:31,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:31,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:31,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:31,086 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:31,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:31,087 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,087 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:31,087 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:31,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:31,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:31,188 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:31,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:31,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:31,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:31,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,199 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:31,199 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:31,200 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:31,200 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:31,201 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,201 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,202 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:31,202 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:31,203 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:31,203 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:31,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:31,204 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:31,204 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:31,205 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:31,205 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:31,205 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:31,626 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101733ad85a163442fbb71f88a9819ce3bb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101733ad85a163442fbb71f88a9819ce3bb 2023-11-12 00:53:32,034 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/71fc751965dd4746b3a2b2ccef9108b2 2023-11-12 00:53:32,043 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/71fc751965dd4746b3a2b2ccef9108b2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71fc751965dd4746b3a2b2ccef9108b2 2023-11-12 00:53:32,053 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71fc751965dd4746b3a2b2ccef9108b2, entries=1, sequenceid=29, filesize=5.0 K 2023-11-12 00:53:32,054 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 849ms, sequenceid=29, compaction requested=true 2023-11-12 00:53:32,055 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:32,055 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:32,055 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:32,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:32,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:32,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:32,061 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:32,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:32,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fda0e77[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:32,064 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:32,064 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,066 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:32,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:32,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:32,066 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,066 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:32,068 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:32,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,068 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:32,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:32,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:32,068 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:32,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:32,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:32,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:32,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:32,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:32,071 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:32,071 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:32,071 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:32,071 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,071 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:32,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:32,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:32,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:32,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:32,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,077 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,080 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,080 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,080 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:32,080 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,080 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:32,080 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,081 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:32,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:32,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-12 00:53:32,081 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:32,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:32,081 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:32,081 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,082 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:32,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:32,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:32,082 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:32,182 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:32,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:32,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:32,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:32,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,193 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:32,193 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:32,193 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:32,193 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:32,194 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,194 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,195 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:32,195 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:32,196 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,196 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:32,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,197 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,197 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:32,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:32,198 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:32,198 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:32,198 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:32,198 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:32,198 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:32,198 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:32,219 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a1fc2ea599e14e8398c69f9a7616463f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1fc2ea599e14e8398c69f9a7616463f 2023-11-12 00:53:32,633 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/44ed0e3dee7541efb2bb67524b2e227a 2023-11-12 00:53:32,640 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/44ed0e3dee7541efb2bb67524b2e227a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/44ed0e3dee7541efb2bb67524b2e227a 2023-11-12 00:53:32,647 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/44ed0e3dee7541efb2bb67524b2e227a, entries=1, sequenceid=33, filesize=5.0 K 2023-11-12 00:53:32,648 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 450ms, sequenceid=33, compaction requested=true 2023-11-12 00:53:32,648 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:32,648 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:32,648 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:32,649 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:32,649 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,649 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:32,649 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:32,651 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,651 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,652 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:32,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:32,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:32,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21e6339f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:32,654 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:32,654 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,657 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,657 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:32,657 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:32,657 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:32,657 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,657 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:32,659 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:32,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:32,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:32,659 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:32,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:32,663 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:32,663 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:32,663 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:32,663 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,663 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:32,665 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,665 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:32,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:32,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,665 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:32,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:32,666 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:32,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,668 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,671 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,672 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,672 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,672 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,672 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:32,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:32,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:32,672 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,672 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:32,672 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,673 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:32,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:32,673 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,673 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:32,673 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:32,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:32,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:32,773 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:32,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:32,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:32,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:32,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,784 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:32,784 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:32,784 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:32,784 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:32,785 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,785 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,787 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,787 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:32,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:32,788 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:32,788 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:32,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:32,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,789 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,789 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:32,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:32,790 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:32,790 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:32,791 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:32,791 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:32,791 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:32,791 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:33,211 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071de779f5c9f7411d9bb6263036661fe3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509071de779f5c9f7411d9bb6263036661fe3 2023-11-12 00:53:33,630 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/445b894d94514d5bbb01329e232f362a 2023-11-12 00:53:33,642 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/445b894d94514d5bbb01329e232f362a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/445b894d94514d5bbb01329e232f362a 2023-11-12 00:53:33,655 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/445b894d94514d5bbb01329e232f362a, entries=1, sequenceid=37, filesize=5.0 K 2023-11-12 00:53:33,657 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 866ms, sequenceid=37, compaction requested=true 2023-11-12 00:53:33,657 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:33,657 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:33,658 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:33,658 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,658 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:33,658 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:33,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,660 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:33,661 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,661 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:33,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:33,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d6850[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:33,663 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:33,663 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,665 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:33,666 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,666 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:33,667 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:33,667 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:33,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:33,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:33,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:33,681 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:33,681 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:33,682 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:33,682 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,682 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:33,685 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:33,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:33,685 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,685 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:33,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:33,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:33,686 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:33,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:33,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,688 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:33,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,695 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:33,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:33,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:33,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:33,696 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,696 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,696 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-12 00:53:33,696 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:33,696 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,696 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:33,697 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:33,697 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:33,697 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:33,797 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:33,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:33,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:33,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:33,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,813 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:33,813 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:33,814 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-12 00:53:33,814 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-12 00:53:33,816 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,816 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,818 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:33,818 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:33,819 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:33,819 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,821 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,823 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-12 00:53:33,823 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:33,824 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-12 00:53:33,824 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:33,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-12 00:53:33,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:33,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:33,825 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:33,826 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. started... 2023-11-12 00:53:33,826 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35029a0c0c81d223a4e45d489958cfeb 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:33,853 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205617f6e9674a459a9b4d15593991a6ff to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205617f6e9674a459a9b4d15593991a6ff 2023-11-12 00:53:34,273 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/59cf1b970649467ea23d5a6d054fcd84 2023-11-12 00:53:34,280 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/59cf1b970649467ea23d5a6d054fcd84 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/59cf1b970649467ea23d5a6d054fcd84 2023-11-12 00:53:34,287 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/59cf1b970649467ea23d5a6d054fcd84, entries=1, sequenceid=41, filesize=5.0 K 2023-11-12 00:53:34,288 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35029a0c0c81d223a4e45d489958cfeb in 462ms, sequenceid=41, compaction requested=true 2023-11-12 00:53:34,288 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:34,288 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:34,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:34,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:34,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-12 00:53:34,289 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-12 00:53:34,290 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,290 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:34,291 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,291 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:34,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-12 00:53:34,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77aa5c59[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:34,292 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-12 00:53:34,293 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,295 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,295 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-12 00:53:34,295 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-12 00:53:34,295 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:34,295 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,295 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:34,297 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,297 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-12 00:53:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:34,297 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:34,297 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-12 00:53:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:34,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-12 00:53:34,301 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-12 00:53:34,301 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:34,301 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:34,301 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,301 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:34,303 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,303 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,303 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:34,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:34,304 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,306 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:34,309 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:34,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:34,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-12 00:53:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:34,309 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:34,310 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,310 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:34,310 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:34,310 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:34,410 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:34,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:34,417 DEBUG [Listener at localhost/40343] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-12 00:53:34,420 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-12 00:53:34,421 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:34,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-12 00:53:34,434 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-12 00:53:34,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:53:34,435 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751014435 2023-11-12 00:53:34,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:53:34,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-12 00:53:34,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:34,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x3abfaa32 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:34,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55321866, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:34,451 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,320 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103facbe3451c1b417ca9fc72237ddf4a8d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103facbe3451c1b417ca9fc72237ddf4a8d 2023-11-12 00:53:35,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:35,340 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:53:35,341 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:53:35,352 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:53:35,354 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:53:35,388 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4b55bade80a641c2ac067c1389e9d5df first=Optional[r3] last=Optional[r6] 2023-11-12 00:53:35,400 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4b55bade80a641c2ac067c1389e9d5df}] 2023-11-12 00:53:35,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4b55bade80a641c2ac067c1389e9d5df for inclusion in 35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:35,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-12 00:53:35,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:53:35,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:35,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4b55bade80a641c2ac067c1389e9d5df to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vdurtp35b5cck5lnsi99er4tqo0uhed8dto6h24pcfjsr4q1oe8u77chuprlu09u/family1/4b55bade80a641c2ac067c1389e9d5df 2023-11-12 00:53:35,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vdurtp35b5cck5lnsi99er4tqo0uhed8dto6h24pcfjsr4q1oe8u77chuprlu09u/family1/4b55bade80a641c2ac067c1389e9d5df as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_ 2023-11-12 00:53:35,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vdurtp35b5cck5lnsi99er4tqo0uhed8dto6h24pcfjsr4q1oe8u77chuprlu09u/family1/4b55bade80a641c2ac067c1389e9d5df into 35029a0c0c81d223a4e45d489958cfeb/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_ - updating store file list. 2023-11-12 00:53:35,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_ into 35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:35,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vdurtp35b5cck5lnsi99er4tqo0uhed8dto6h24pcfjsr4q1oe8u77chuprlu09u/family1/4b55bade80a641c2ac067c1389e9d5df into 35029a0c0c81d223a4e45d489958cfeb/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_) 2023-11-12 00:53:35,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vdurtp35b5cck5lnsi99er4tqo0uhed8dto6h24pcfjsr4q1oe8u77chuprlu09u/family1/4b55bade80a641c2ac067c1389e9d5df 2023-11-12 00:53:35,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:53:35,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:53:35,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 35029a0c0c81d223a4e45d489958cfeb/family1 is initiating minor compaction 2023-11-12 00:53:35,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@787a910f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:35,446 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 35029a0c0c81d223a4e45d489958cfeb/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:35,447 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/d5d5428319cd4a0e98ac976e8d9cfdee, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/df3426beeb254b0d89e45c2628155157, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/e616b42920f545939dee39a14308beac, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/250b3c2902c444de82498f2a999e1c8a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/0d7a7e5891a2431aab04d369925c759d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71fc751965dd4746b3a2b2ccef9108b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/44ed0e3dee7541efb2bb67524b2e227a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/445b894d94514d5bbb01329e232f362a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/59cf1b970649467ea23d5a6d054fcd84, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp, totalSize=50.2 K 2023-11-12 00:53:35,447 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting d5d5428319cd4a0e98ac976e8d9cfdee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting df3426beeb254b0d89e45c2628155157, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting e616b42920f545939dee39a14308beac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 250b3c2902c444de82498f2a999e1c8a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 0d7a7e5891a2431aab04d369925c759d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 71fc751965dd4746b3a2b2ccef9108b2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 44ed0e3dee7541efb2bb67524b2e227a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 445b894d94514d5bbb01329e232f362a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 59cf1b970649467ea23d5a6d054fcd84, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:53:35,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting fac26791e13d45788f7aaab8365acc1e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:53:35,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:35,462 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:35,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512288919a757b17343208699c362609d6a99 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512288919a757b17343208699c362609d6a99 2023-11-12 00:53:35,469 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512319ae3b0a88b414e1a893ce65b1e9403af to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512319ae3b0a88b414e1a893ce65b1e9403af 2023-11-12 00:53:35,472 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101733ad85a163442fbb71f88a9819ce3bb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101733ad85a163442fbb71f88a9819ce3bb 2023-11-12 00:53:35,474 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1fc2ea599e14e8398c69f9a7616463f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1fc2ea599e14e8398c69f9a7616463f 2023-11-12 00:53:35,474 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-12 00:53:35,474 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:35,510 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 35029a0c0c81d223a4e45d489958cfeb#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:53:35,945 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/8aaa198e61954ac3b3882aed42bbd580 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/8aaa198e61954ac3b3882aed42bbd580 2023-11-12 00:53:35,962 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 35029a0c0c81d223a4e45d489958cfeb/family1 of 35029a0c0c81d223a4e45d489958cfeb into 8aaa198e61954ac3b3882aed42bbd580(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:53:35,962 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:35,963 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699750415444; duration=0sec 2023-11-12 00:53:35,964 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:35,978 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120531ce4d14be1d42c5a38404fbb8322273 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120531ce4d14be1d42c5a38404fbb8322273 2023-11-12 00:53:35,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:36,013 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/149129f27273401fb670dbc99b8a5bd6 first=Optional[r00] last=Optional[r2] 2023-11-12 00:53:36,014 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/149129f27273401fb670dbc99b8a5bd6}] 2023-11-12 00:53:36,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/149129f27273401fb670dbc99b8a5bd6 for inclusion in 35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:36,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-12 00:53:36,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:53:36,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:36,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/149129f27273401fb670dbc99b8a5bd6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3ctef3fso5fof1aspm9do5pq7ssb6mropa57v1gm2iijrgrkre93n66eoj6r5kqf/family1/149129f27273401fb670dbc99b8a5bd6 2023-11-12 00:53:36,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3ctef3fso5fof1aspm9do5pq7ssb6mropa57v1gm2iijrgrkre93n66eoj6r5kqf/family1/149129f27273401fb670dbc99b8a5bd6 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_ 2023-11-12 00:53:36,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3ctef3fso5fof1aspm9do5pq7ssb6mropa57v1gm2iijrgrkre93n66eoj6r5kqf/family1/149129f27273401fb670dbc99b8a5bd6 into 35029a0c0c81d223a4e45d489958cfeb/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_ - updating store file list. 2023-11-12 00:53:36,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_ into 35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:36,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3ctef3fso5fof1aspm9do5pq7ssb6mropa57v1gm2iijrgrkre93n66eoj6r5kqf/family1/149129f27273401fb670dbc99b8a5bd6 into 35029a0c0c81d223a4e45d489958cfeb/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_) 2023-11-12 00:53:36,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3ctef3fso5fof1aspm9do5pq7ssb6mropa57v1gm2iijrgrkre93n66eoj6r5kqf/family1/149129f27273401fb670dbc99b8a5bd6 2023-11-12 00:53:36,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:53:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:53:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 35029a0c0c81d223a4e45d489958cfeb/family1 is initiating minor compaction (all files) 2023-11-12 00:53:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30934368; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:36,042 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 35029a0c0c81d223a4e45d489958cfeb/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:36,043 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/3f9130007fc9442da6df5e2901596b07, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/8aaa198e61954ac3b3882aed42bbd580, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp, totalSize=358.6 K 2023-11-12 00:53:36,044 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 3f9130007fc9442da6df5e2901596b07, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:53:36,045 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 8aaa198e61954ac3b3882aed42bbd580, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:53:36,046 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823723 2023-11-12 00:53:36,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:36,049 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:36,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130442d63e6e6dc40088f8e0b9f9b552fa1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130442d63e6e6dc40088f8e0b9f9b552fa1 2023-11-12 00:53:36,055 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb6e93969a4443f78f7193d908533466 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb6e93969a4443f78f7193d908533466 2023-11-12 00:53:36,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120570a9d5ed8e344efe8fa641a14e360b74 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120570a9d5ed8e344efe8fa641a14e360b74 2023-11-12 00:53:36,057 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-12 00:53:36,057 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-12 00:53:36,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:36,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:36,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:53:36,059 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-12 00:53:36,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6330 sec 2023-11-12 00:53:36,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/d5d5428319cd4a0e98ac976e8d9cfdee, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/df3426beeb254b0d89e45c2628155157, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/e616b42920f545939dee39a14308beac, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/250b3c2902c444de82498f2a999e1c8a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/0d7a7e5891a2431aab04d369925c759d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71fc751965dd4746b3a2b2ccef9108b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/44ed0e3dee7541efb2bb67524b2e227a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/445b894d94514d5bbb01329e232f362a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/59cf1b970649467ea23d5a6d054fcd84, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_] to archive 2023-11-12 00:53:36,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:36,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/d5d5428319cd4a0e98ac976e8d9cfdee to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/d5d5428319cd4a0e98ac976e8d9cfdee 2023-11-12 00:53:36,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/df3426beeb254b0d89e45c2628155157 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/df3426beeb254b0d89e45c2628155157 2023-11-12 00:53:36,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/e616b42920f545939dee39a14308beac to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/e616b42920f545939dee39a14308beac 2023-11-12 00:53:36,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/250b3c2902c444de82498f2a999e1c8a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/250b3c2902c444de82498f2a999e1c8a 2023-11-12 00:53:36,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/0d7a7e5891a2431aab04d369925c759d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/0d7a7e5891a2431aab04d369925c759d 2023-11-12 00:53:36,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71fc751965dd4746b3a2b2ccef9108b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71fc751965dd4746b3a2b2ccef9108b2 2023-11-12 00:53:36,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/44ed0e3dee7541efb2bb67524b2e227a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/44ed0e3dee7541efb2bb67524b2e227a 2023-11-12 00:53:36,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/445b894d94514d5bbb01329e232f362a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/445b894d94514d5bbb01329e232f362a 2023-11-12 00:53:36,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/59cf1b970649467ea23d5a6d054fcd84 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/59cf1b970649467ea23d5a6d054fcd84 2023-11-12 00:53:36,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/fac26791e13d45788f7aaab8365acc1e_SeqId_44_ 2023-11-12 00:53:36,101 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 35029a0c0c81d223a4e45d489958cfeb#family1#compaction#11 average throughput is 5.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:53:36,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-12 00:53:36,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:36,679 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-12 00:53:36,682 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:36,682 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-12 00:53:36,686 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-12 00:53:36,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, REOPEN/MOVE}] 2023-11-12 00:53:36,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, REOPEN/MOVE 2023-11-12 00:53:36,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=35029a0c0c81d223a4e45d489958cfeb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:36,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750416703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750416703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750416703"}]},"ts":"1699750416703"} 2023-11-12 00:53:36,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 35029a0c0c81d223a4e45d489958cfeb, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:36,863 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:36,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:36,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 35029a0c0c81d223a4e45d489958cfeb, disabling compactions & flushes 2023-11-12 00:53:36,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:36,956 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/.tmp/family1/71f44bc6c2bd4f5f96bb7a0184a2760e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71f44bc6c2bd4f5f96bb7a0184a2760e 2023-11-12 00:53:36,974 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 35029a0c0c81d223a4e45d489958cfeb/family1 of 35029a0c0c81d223a4e45d489958cfeb into 71f44bc6c2bd4f5f96bb7a0184a2760e(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:53:36,974 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:36,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:36,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:36,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. after waiting 0 ms 2023-11-12 00:53:36,975 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1699750416042; duration=0sec 2023-11-12 00:53:36,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:36,975 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:36,978 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/3f9130007fc9442da6df5e2901596b07, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/8aaa198e61954ac3b3882aed42bbd580, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_] to archive 2023-11-12 00:53:36,979 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:36,981 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/3f9130007fc9442da6df5e2901596b07 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/3f9130007fc9442da6df5e2901596b07 2023-11-12 00:53:36,983 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/8aaa198e61954ac3b3882aed42bbd580 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/8aaa198e61954ac3b3882aed42bbd580 2023-11-12 00:53:36,985 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/42dae7962ab042a1aaf11a28e24e86e5_SeqId_47_ 2023-11-12 00:53:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-12 00:53:36,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:36,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:36,993 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 35029a0c0c81d223a4e45d489958cfeb to self. 2023-11-12 00:53:36,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:36,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=35029a0c0c81d223a4e45d489958cfeb, regionState=CLOSED 2023-11-12 00:53:36,996 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750416996"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750416996"}]},"ts":"1699750416996"} 2023-11-12 00:53:37,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-12 00:53:37,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 35029a0c0c81d223a4e45d489958cfeb, server=jenkins-hbase4.apache.org,43681,1699750400629 in 293 msec 2023-11-12 00:53:37,001 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=true 2023-11-12 00:53:37,152 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=35029a0c0c81d223a4e45d489958cfeb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:37,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750417152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750417152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750417152"}]},"ts":"1699750417152"} 2023-11-12 00:53:37,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 35029a0c0c81d223a4e45d489958cfeb, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:37,306 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:37,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:37,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 35029a0c0c81d223a4e45d489958cfeb, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:37,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:37,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,311 INFO [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,313 DEBUG [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:37,313 DEBUG [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:37,313 INFO [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35029a0c0c81d223a4e45d489958cfeb columnFamilyName family1 2023-11-12 00:53:37,320 DEBUG [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/71f44bc6c2bd4f5f96bb7a0184a2760e 2023-11-12 00:53:37,321 INFO [StoreOpener-35029a0c0c81d223a4e45d489958cfeb-1] regionserver.HStore(310): Store=35029a0c0c81d223a4e45d489958cfeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:37,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:53:37,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 35029a0c0c81d223a4e45d489958cfeb; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63686741, jitterRate=-0.05099360644817352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:53:37,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:37,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., pid=17, masterSystemTime=1699750417306 2023-11-12 00:53:37,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:37,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:53:37,331 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=35029a0c0c81d223a4e45d489958cfeb, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:37,331 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699750417331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750417331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750417331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750417331"}]},"ts":"1699750417331"} 2023-11-12 00:53:37,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-12 00:53:37,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 35029a0c0c81d223a4e45d489958cfeb, server=jenkins-hbase4.apache.org,43681,1699750400629 in 179 msec 2023-11-12 00:53:37,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-12 00:53:37,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=35029a0c0c81d223a4e45d489958cfeb, REOPEN/MOVE in 636 msec 2023-11-12 00:53:37,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-12 00:53:37,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 654 msec 2023-11-12 00:53:37,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0850 sec 2023-11-12 00:53:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-12 00:53:37,353 INFO [Listener at localhost/40343] compactions.TestMobCompactor(278): alter status finished 2023-11-12 00:53:37,355 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-12 00:53:37,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-12 00:53:37,358 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-12 00:53:37,359 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751017359 2023-11-12 00:53:37,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:53:37,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:53:37,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-12 00:53:37,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:37,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x452ae3ab to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:37,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d8c3c33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:37,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:37,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:37,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:37,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:37,400 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:38,250 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283bd19e9f2de740e48a2311172fd32ff0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511283bd19e9f2de740e48a2311172fd32ff0 2023-11-12 00:53:38,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:38,264 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:53:38,265 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:53:38,272 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:53:38,274 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:53:38,285 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1fc8f9cce8cc48d798aacbd3f78916d2 first=Optional[r05] last=Optional[r8] 2023-11-12 00:53:38,286 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1fc8f9cce8cc48d798aacbd3f78916d2}] 2023-11-12 00:53:38,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1fc8f9cce8cc48d798aacbd3f78916d2 for inclusion in 35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:38,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-12 00:53:38,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:53:38,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:53:38,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1fc8f9cce8cc48d798aacbd3f78916d2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5c5kjp0gmvv7eau0267pufjpk0ksfppkpjes4cl4u5n6590v12ip8dt4jb0q1iun/family1/1fc8f9cce8cc48d798aacbd3f78916d2 2023-11-12 00:53:38,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5c5kjp0gmvv7eau0267pufjpk0ksfppkpjes4cl4u5n6590v12ip8dt4jb0q1iun/family1/1fc8f9cce8cc48d798aacbd3f78916d2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/146ec32f07b048f384952ade238d665e_SeqId_53_ 2023-11-12 00:53:38,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5c5kjp0gmvv7eau0267pufjpk0ksfppkpjes4cl4u5n6590v12ip8dt4jb0q1iun/family1/1fc8f9cce8cc48d798aacbd3f78916d2 into 35029a0c0c81d223a4e45d489958cfeb/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/146ec32f07b048f384952ade238d665e_SeqId_53_ - updating store file list. 2023-11-12 00:53:38,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/146ec32f07b048f384952ade238d665e_SeqId_53_ into 35029a0c0c81d223a4e45d489958cfeb/family1 2023-11-12 00:53:38,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5c5kjp0gmvv7eau0267pufjpk0ksfppkpjes4cl4u5n6590v12ip8dt4jb0q1iun/family1/1fc8f9cce8cc48d798aacbd3f78916d2 into 35029a0c0c81d223a4e45d489958cfeb/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/family1/146ec32f07b048f384952ade238d665e_SeqId_53_) 2023-11-12 00:53:38,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5c5kjp0gmvv7eau0267pufjpk0ksfppkpjes4cl4u5n6590v12ip8dt4jb0q1iun/family1/1fc8f9cce8cc48d798aacbd3f78916d2 2023-11-12 00:53:38,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:38,307 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:38,309 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205617f6e9674a459a9b4d15593991a6ff to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205617f6e9674a459a9b4d15593991a6ff 2023-11-12 00:53:38,310 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285fa9964307744f6b903f3dd881ca89b4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285fa9964307744f6b903f3dd881ca89b4 2023-11-12 00:53:38,310 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-12 00:53:38,310 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-12 00:53:38,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:38,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:38,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-12 00:53:38,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-12 00:53:38,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:53:38,312 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-12 00:53:38,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 956 msec 2023-11-12 00:53:38,393 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=251 (was 213) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51520 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33036 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51532 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33098 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51490 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33114 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51634 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51624 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x3abfaa32-SendThread(127.0.0.1:60532) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51466 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:43681-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2c34e4fe-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51538 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51508 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33086 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2c34e4fe-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77e2fb76-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x77e2fb76-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x452ae3ab-SendThread(127.0.0.1:60532) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33134 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2c34e4fe-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x452ae3ab-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33076 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2126735078_17 at /127.0.0.1:33130 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:51472 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:33012 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x3abfaa32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/180040172.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x3abfaa32-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x452ae3ab sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/180040172.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=625 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=315 (was 322), ProcessCount=172 (was 172), AvailableMemoryMB=1137 (was 1550) 2023-11-12 00:53:38,405 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=172, AvailableMemoryMB=1136 2023-11-12 00:53:38,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-12 00:53:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:38,410 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:53:38,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-12 00:53:38,411 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:53:38,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-12 00:53:38,412 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:38,413 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6 empty. 2023-11-12 00:53:38,414 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:38,414 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-12 00:53:38,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-12 00:53:38,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-12 00:53:38,823 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:38,824 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 263a67b07df9665bc258d032dba0f4e6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:53:39,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-12 00:53:39,232 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:39,232 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 263a67b07df9665bc258d032dba0f4e6, disabling compactions & flushes 2023-11-12 00:53:39,232 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,232 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,232 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. after waiting 0 ms 2023-11-12 00:53:39,232 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,232 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,232 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:39,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:53:39,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699750419237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750419237"}]},"ts":"1699750419237"} 2023-11-12 00:53:39,239 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:53:39,240 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:53:39,240 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750419240"}]},"ts":"1699750419240"} 2023-11-12 00:53:39,242 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-12 00:53:39,246 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=263a67b07df9665bc258d032dba0f4e6, ASSIGN}] 2023-11-12 00:53:39,248 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=263a67b07df9665bc258d032dba0f4e6, ASSIGN 2023-11-12 00:53:39,250 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=263a67b07df9665bc258d032dba0f4e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:53:39,400 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=263a67b07df9665bc258d032dba0f4e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:39,401 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699750419400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750419400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750419400"}]},"ts":"1699750419400"} 2023-11-12 00:53:39,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 263a67b07df9665bc258d032dba0f4e6, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:39,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-12 00:53:39,555 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:39,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 263a67b07df9665bc258d032dba0f4e6, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:39,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:39,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,560 INFO [StoreOpener-263a67b07df9665bc258d032dba0f4e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,562 DEBUG [StoreOpener-263a67b07df9665bc258d032dba0f4e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:39,562 DEBUG [StoreOpener-263a67b07df9665bc258d032dba0f4e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:39,562 INFO [StoreOpener-263a67b07df9665bc258d032dba0f4e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 263a67b07df9665bc258d032dba0f4e6 columnFamilyName family1 2023-11-12 00:53:39,564 INFO [StoreOpener-263a67b07df9665bc258d032dba0f4e6-1] regionserver.HStore(310): Store=263a67b07df9665bc258d032dba0f4e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:39,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:53:39,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:53:39,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 263a67b07df9665bc258d032dba0f4e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62356817, jitterRate=-0.07081101834774017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:53:39,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:39,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6., pid=21, masterSystemTime=1699750419555 2023-11-12 00:53:39,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:39,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=263a67b07df9665bc258d032dba0f4e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:39,575 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699750419574"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750419574"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750419574"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750419574"}]},"ts":"1699750419574"} 2023-11-12 00:53:39,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-12 00:53:39,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 263a67b07df9665bc258d032dba0f4e6, server=jenkins-hbase4.apache.org,43681,1699750400629 in 173 msec 2023-11-12 00:53:39,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-12 00:53:39,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=263a67b07df9665bc258d032dba0f4e6, ASSIGN in 333 msec 2023-11-12 00:53:39,581 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:53:39,582 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750419582"}]},"ts":"1699750419582"} 2023-11-12 00:53:39,583 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-12 00:53:39,586 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:53:39,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1780 sec 2023-11-12 00:53:40,333 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:40,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-12 00:53:40,518 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-12 00:53:40,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:40,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,568 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:40,568 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:40,568 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:40,568 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:40,569 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,569 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:40,571 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:40,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:40,571 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:40,571 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:40,578 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:40,578 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:40,580 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:40,580 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:40,580 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:40,580 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:40,580 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:40,581 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:53:41,020 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130114d4acdcf904c87a9a6ccd855d1a0fc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130114d4acdcf904c87a9a6ccd855d1a0fc 2023-11-12 00:53:41,024 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/647f271224644202bb14061a0e49ccc3 2023-11-12 00:53:41,030 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/647f271224644202bb14061a0e49ccc3 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/647f271224644202bb14061a0e49ccc3 2023-11-12 00:53:41,036 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/647f271224644202bb14061a0e49ccc3, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-12 00:53:41,037 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 456ms, sequenceid=5, compaction requested=false 2023-11-12 00:53:41,038 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:41,038 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:41,038 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:41,038 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:41,038 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,038 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:41,038 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:41,045 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,045 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:41,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:41,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@483c5d6d[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:41,047 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:41,048 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,049 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,049 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:41,049 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:41,049 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:41,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:41,051 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:41,051 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:41,051 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:41,052 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:41,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:41,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:41,055 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:41,055 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:41,055 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:41,055 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,055 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:41,057 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,057 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:41,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,057 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:41,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:41,058 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,060 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:41,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,068 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:41,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:41,068 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:41,069 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:41,069 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,069 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:41,070 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:41,170 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:41,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:41,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:41,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:41,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,184 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:41,184 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:41,185 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:41,185 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:41,186 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,186 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,188 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,188 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:41,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:41,188 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,188 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,189 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:41,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,193 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:41,193 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:41,193 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:41,194 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:41,194 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:41,194 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:41,194 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:41,194 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:53:41,622 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287173bb5a335442ca8acfa9f10f2b20a6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511287173bb5a335442ca8acfa9f10f2b20a6 2023-11-12 00:53:41,627 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/3f1db7cc7b21492a947ca1cf25bfe638 2023-11-12 00:53:41,633 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/3f1db7cc7b21492a947ca1cf25bfe638 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/3f1db7cc7b21492a947ca1cf25bfe638 2023-11-12 00:53:41,638 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/3f1db7cc7b21492a947ca1cf25bfe638, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:53:41,639 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 445ms, sequenceid=9, compaction requested=false 2023-11-12 00:53:41,639 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:41,639 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:41,639 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:41,641 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,641 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:41,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,642 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5856f53e[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:41,643 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:41,643 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,645 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:41,645 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,645 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:41,648 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:41,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:41,652 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:41,652 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:41,652 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:41,652 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,652 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:41,654 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,654 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:41,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,654 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:41,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:41,655 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,657 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:41,660 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,660 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:41,661 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:41,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:41,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:41,661 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,661 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:41,662 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:41,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:41,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:41,762 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:41,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:41,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:41,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:41,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,769 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:41,769 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:41,769 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:41,770 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:41,770 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,770 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,771 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,771 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:41,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:41,772 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:41,772 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:41,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,773 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,773 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:41,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:41,774 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:41,774 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:41,774 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:41,774 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:41,774 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:41,774 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:42,189 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120156b3b6b07a3c4fd8b8dffc11343bb699 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120156b3b6b07a3c4fd8b8dffc11343bb699 2023-11-12 00:53:42,526 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:53:42,595 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/b2673d5399b14143a3ef5e6df529bbb1 2023-11-12 00:53:42,602 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/b2673d5399b14143a3ef5e6df529bbb1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/b2673d5399b14143a3ef5e6df529bbb1 2023-11-12 00:53:42,608 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/b2673d5399b14143a3ef5e6df529bbb1, entries=1, sequenceid=13, filesize=4.9 K 2023-11-12 00:53:42,608 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 834ms, sequenceid=13, compaction requested=true 2023-11-12 00:53:42,609 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:42,609 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:42,609 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:42,609 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:42,609 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,609 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:42,609 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:42,612 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,612 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:42,612 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,612 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3342798c[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:42,614 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:42,614 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,616 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:42,616 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,616 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:42,616 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:42,616 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:42,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:42,617 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:42,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:42,622 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:42,622 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:42,622 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:42,622 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,622 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:42,624 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,624 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,624 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:42,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:42,625 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,629 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,633 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,633 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,633 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,633 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,633 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:42,633 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:42,634 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:42,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:42,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:42,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:53:42,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:42,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:42,634 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,634 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:42,635 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,636 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:42,636 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:42,736 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:42,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:42,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:42,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:42,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,744 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:42,744 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:42,744 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:42,745 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:42,745 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,745 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,746 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,746 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:42,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:42,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:42,747 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:42,747 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:42,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:42,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:42,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:42,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:42,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:42,749 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:42,749 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:42,749 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:42,749 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:42,749 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:42,749 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:43,164 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205aafeba6fadf348cb888304dddb6c26e6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205aafeba6fadf348cb888304dddb6c26e6 2023-11-12 00:53:43,573 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/729c8cbb3d1440e5830542b274c181ea 2023-11-12 00:53:43,580 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/729c8cbb3d1440e5830542b274c181ea as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/729c8cbb3d1440e5830542b274c181ea 2023-11-12 00:53:43,585 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/729c8cbb3d1440e5830542b274c181ea, entries=1, sequenceid=17, filesize=4.9 K 2023-11-12 00:53:43,586 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 837ms, sequenceid=17, compaction requested=true 2023-11-12 00:53:43,586 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:43,586 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:43,586 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:43,637 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:43,637 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:43,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:43,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16afb329[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:43,639 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:43,639 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,683 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,683 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:43,683 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:43,684 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:43,684 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,684 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:43,774 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:43,774 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,775 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:43,775 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:43,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:43,778 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:43,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:43,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:43,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,778 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:43,821 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,821 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:43,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,822 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:43,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:43,822 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,824 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,845 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,845 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:43,845 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,845 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:43,845 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:43,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:43,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:43,845 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:43,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,846 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:43,846 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:43,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:43,946 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:43,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:43,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:43,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:43,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,958 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:43,958 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:43,958 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:43,958 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:43,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,961 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:43,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:43,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:43,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,963 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,963 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:43,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:43,963 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:43,963 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:43,964 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:43,964 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:43,964 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:43,964 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:43,964 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:43,964 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:43,986 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282e30492977c849f8a1c9b9016fcd4bdd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282e30492977c849f8a1c9b9016fcd4bdd 2023-11-12 00:53:44,392 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/e3466361414946c9886fdb0876d6acb1 2023-11-12 00:53:44,398 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/e3466361414946c9886fdb0876d6acb1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/e3466361414946c9886fdb0876d6acb1 2023-11-12 00:53:44,403 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/e3466361414946c9886fdb0876d6acb1, entries=1, sequenceid=21, filesize=4.9 K 2023-11-12 00:53:44,404 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 440ms, sequenceid=21, compaction requested=true 2023-11-12 00:53:44,404 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:44,404 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:44,404 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:44,406 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:44,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:44,406 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,406 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:44,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:44,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c5253a4[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:44,408 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:44,408 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,409 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,409 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:44,409 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:44,409 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:44,409 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,410 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:44,411 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:44,411 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:44,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:44,412 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:44,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:44,415 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:44,415 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:44,415 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:44,415 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,415 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:44,417 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,417 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:44,417 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:44,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:44,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:44,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:44,417 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,419 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:44,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:44,421 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:44,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:53:44,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:44,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:44,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:44,422 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,422 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,422 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,422 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:44,422 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:44,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:44,523 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:44,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:44,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:44,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:44,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,530 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:44,530 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:44,530 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:44,530 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:44,531 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,531 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,532 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:44,532 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,533 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:44,533 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:44,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,534 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:44,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:44,535 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:44,536 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:44,536 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:44,536 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:44,536 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:44,537 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:44,954 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123135597bdec541457c80d38da95e75337e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123135597bdec541457c80d38da95e75337e 2023-11-12 00:53:45,360 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/9c1746ccc4da49bfb6ced2fc7af962fd 2023-11-12 00:53:45,368 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/9c1746ccc4da49bfb6ced2fc7af962fd as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9c1746ccc4da49bfb6ced2fc7af962fd 2023-11-12 00:53:45,376 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9c1746ccc4da49bfb6ced2fc7af962fd, entries=1, sequenceid=25, filesize=4.9 K 2023-11-12 00:53:45,377 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 840ms, sequenceid=25, compaction requested=true 2023-11-12 00:53:45,377 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:45,377 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:45,378 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:45,380 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,380 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:45,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:45,380 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,380 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:45,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:45,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:45,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:45,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:45,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53c2ae15[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:45,383 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:45,383 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,385 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,385 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:45,385 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:45,385 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:45,385 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,385 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:45,388 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:45,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:45,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:45,388 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:45,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:45,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:45,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:45,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:45,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:45,392 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:45,392 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:45,392 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:45,392 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,392 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:45,394 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,394 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:45,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,394 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:45,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:45,395 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,396 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:45,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,399 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,399 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:45,399 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:45,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:45,399 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:45,399 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:45,400 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,399 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:45,400 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:45,400 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:45,400 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:45,400 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:45,401 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:45,501 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:45,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:45,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:45,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:45,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,508 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:45,508 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,509 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,512 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,512 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:45,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:45,512 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:45,513 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,513 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,514 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:45,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:45,514 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:45,514 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:45,515 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:45,515 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:45,515 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:45,515 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:45,515 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:45,515 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:45,936 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016df6e259135e438e99090620efb5339f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601016df6e259135e438e99090620efb5339f 2023-11-12 00:53:46,342 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/c9f4df15021e460691dcb840509bc031 2023-11-12 00:53:46,349 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/c9f4df15021e460691dcb840509bc031 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c9f4df15021e460691dcb840509bc031 2023-11-12 00:53:46,353 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c9f4df15021e460691dcb840509bc031, entries=1, sequenceid=29, filesize=4.9 K 2023-11-12 00:53:46,354 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 839ms, sequenceid=29, compaction requested=true 2023-11-12 00:53:46,354 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:46,354 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:46,355 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:46,355 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:46,355 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,355 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:46,355 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:46,359 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,359 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:46,360 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:46,360 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:46,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:46,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73ec33f8[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:46,361 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:46,362 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,363 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,363 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:46,363 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:46,363 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:46,363 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,363 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:46,364 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:46,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,364 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:46,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:46,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:46,365 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:46,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:46,368 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:46,368 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:46,368 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:46,368 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,368 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:46,370 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,370 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,370 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:46,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:46,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:46,370 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:46,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,372 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:46,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:46,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:46,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:46,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:46,375 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:46,375 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,376 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,376 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:46,376 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,376 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:46,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:46,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:46,477 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:46,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:46,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:46,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:46,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,486 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:46,486 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:46,486 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:46,486 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:46,487 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,487 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,488 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:46,489 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:46,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:46,489 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:46,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,489 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:46,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:46,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,490 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,490 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:46,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:46,490 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:46,490 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:46,491 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:46,491 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:46,491 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:46,491 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:46,491 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:46,491 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:46,908 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033865160f1a574a1e94bc02dfcf9364f3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033865160f1a574a1e94bc02dfcf9364f3 2023-11-12 00:53:47,315 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/2f7aa948042241c1a7bfc8bb332ab4a2 2023-11-12 00:53:47,321 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/2f7aa948042241c1a7bfc8bb332ab4a2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2f7aa948042241c1a7bfc8bb332ab4a2 2023-11-12 00:53:47,326 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2f7aa948042241c1a7bfc8bb332ab4a2, entries=1, sequenceid=33, filesize=4.9 K 2023-11-12 00:53:47,327 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 836ms, sequenceid=33, compaction requested=true 2023-11-12 00:53:47,327 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:47,327 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:47,327 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:47,327 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:47,327 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,327 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:47,327 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:47,329 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,329 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:47,329 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:47,329 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:47,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:47,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18b1e057[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:47,331 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:47,331 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,333 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,333 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:47,333 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:47,333 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:47,333 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,333 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:47,335 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:47,335 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,335 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:47,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:47,335 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:47,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:47,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:47,338 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:47,338 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:47,338 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:47,338 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,338 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:47,340 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,340 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:47,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:47,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,340 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:47,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:47,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:47,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:47,341 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:47,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,342 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:47,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,345 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,345 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,345 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:47,345 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:47,345 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:47,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:47,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:47,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:47,345 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,345 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:47,346 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,346 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,346 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:47,346 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:47,346 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:47,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:47,446 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:47,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:47,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:47,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:47,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,456 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:47,456 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:47,456 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:47,456 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:47,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,458 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:47,458 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:47,459 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:47,459 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:47,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,460 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,460 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:47,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:47,460 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:47,460 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:47,461 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:47,461 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:47,461 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:47,461 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:47,461 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:47,461 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:47,882 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073d2cf0ebab7f47138a9d8c8431cc28ae to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509073d2cf0ebab7f47138a9d8c8431cc28ae 2023-11-12 00:53:48,288 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/be99281d571b4109a8c8120d1206c592 2023-11-12 00:53:48,294 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/be99281d571b4109a8c8120d1206c592 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/be99281d571b4109a8c8120d1206c592 2023-11-12 00:53:48,299 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/be99281d571b4109a8c8120d1206c592, entries=1, sequenceid=37, filesize=4.9 K 2023-11-12 00:53:48,300 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 839ms, sequenceid=37, compaction requested=true 2023-11-12 00:53:48,300 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:48,300 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:48,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:48,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:48,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:48,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,303 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,303 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:48,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:48,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:48,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36d04f96[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:48,305 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:48,305 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,306 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:48,307 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:48,307 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,307 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:48,308 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,308 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:48,308 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:48,308 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:48,311 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:48,311 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:48,311 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:48,311 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,311 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:48,313 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,313 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,313 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:48,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:48,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:48,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:48,314 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,315 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:48,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:48,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:48,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:48,321 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:48,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,322 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:48,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:48,422 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:48,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:48,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:48,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:48,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,429 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:48,429 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:48,430 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:53:48,430 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:48,430 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,430 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,431 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,431 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:48,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:48,432 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:48,432 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:48,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:48,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,433 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,433 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:53:48,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:48,433 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:53:48,433 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:48,434 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:53:48,434 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:48,434 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:48,434 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:48,434 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. started... 2023-11-12 00:53:48,435 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 263a67b07df9665bc258d032dba0f4e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:48,849 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205e0ca71d2a8644bab85a7fbe0b42e93a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511205e0ca71d2a8644bab85a7fbe0b42e93a 2023-11-12 00:53:49,255 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/9a0c5a15590e4b7a8eb410340be604ed 2023-11-12 00:53:49,263 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/9a0c5a15590e4b7a8eb410340be604ed as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9a0c5a15590e4b7a8eb410340be604ed 2023-11-12 00:53:49,270 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9a0c5a15590e4b7a8eb410340be604ed, entries=1, sequenceid=41, filesize=4.9 K 2023-11-12 00:53:49,271 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 263a67b07df9665bc258d032dba0f4e6 in 836ms, sequenceid=41, compaction requested=true 2023-11-12 00:53:49,271 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:49,271 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:53:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:53:49,273 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,273 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:49,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:53:49,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7024fd5f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:49,277 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:49,277 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,279 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:53:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:49,279 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,280 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:53:49,281 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:49,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:49,286 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:53:49,286 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:49,286 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:49,286 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,286 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:49,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:49,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:49,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,291 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:49,292 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,294 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,295 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:49,295 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:49,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-12 00:53:49,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:49,295 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:49,295 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:49,295 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:49,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,296 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:49,297 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:49,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:49,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:49,397 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:49,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:49,399 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-12 00:53:49,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:53:49,402 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:53:49,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:53:49,403 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751029403 2023-11-12 00:53:49,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:53:49,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-12 00:53:49,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:49,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x07125198 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:53:49,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bc398ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:53:49,411 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:49,842 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103faa74af99b0c4410854879356f90f89a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103faa74af99b0c4410854879356f90f89a 2023-11-12 00:53:49,843 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:49,856 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:53:49,857 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:53:49,863 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:53:49,864 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:53:49,874 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/364618733c4a41fda47b8795b4d12c1c first=Optional[r5] last=Optional[r6] 2023-11-12 00:53:49,874 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/364618733c4a41fda47b8795b4d12c1c}] 2023-11-12 00:53:49,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/364618733c4a41fda47b8795b4d12c1c for inclusion in 263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:49,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-12 00:53:49,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:53:49,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/364618733c4a41fda47b8795b4d12c1c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3v81ho5g40e210jgj649l66b5c0jjl598r3r8r6cdenllkbfhr6o5bjpihlpepuo/family1/364618733c4a41fda47b8795b4d12c1c 2023-11-12 00:53:49,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3v81ho5g40e210jgj649l66b5c0jjl598r3r8r6cdenllkbfhr6o5bjpihlpepuo/family1/364618733c4a41fda47b8795b4d12c1c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_ 2023-11-12 00:53:49,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3v81ho5g40e210jgj649l66b5c0jjl598r3r8r6cdenllkbfhr6o5bjpihlpepuo/family1/364618733c4a41fda47b8795b4d12c1c into 263a67b07df9665bc258d032dba0f4e6/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_ - updating store file list. 2023-11-12 00:53:49,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_ into 263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:49,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3v81ho5g40e210jgj649l66b5c0jjl598r3r8r6cdenllkbfhr6o5bjpihlpepuo/family1/364618733c4a41fda47b8795b4d12c1c into 263a67b07df9665bc258d032dba0f4e6/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_) 2023-11-12 00:53:49,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3v81ho5g40e210jgj649l66b5c0jjl598r3r8r6cdenllkbfhr6o5bjpihlpepuo/family1/364618733c4a41fda47b8795b4d12c1c 2023-11-12 00:53:49,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:53:49,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:53:49,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 263a67b07df9665bc258d032dba0f4e6/family1 is initiating minor compaction 2023-11-12 00:53:49,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9ad3611; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:49,897 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 263a67b07df9665bc258d032dba0f4e6/family1 in testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:49,898 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/3f1db7cc7b21492a947ca1cf25bfe638, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/b2673d5399b14143a3ef5e6df529bbb1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/729c8cbb3d1440e5830542b274c181ea, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/e3466361414946c9886fdb0876d6acb1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9c1746ccc4da49bfb6ced2fc7af962fd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c9f4df15021e460691dcb840509bc031, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2f7aa948042241c1a7bfc8bb332ab4a2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/be99281d571b4109a8c8120d1206c592, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9a0c5a15590e4b7a8eb410340be604ed, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp, totalSize=49.7 K 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 3f1db7cc7b21492a947ca1cf25bfe638, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting b2673d5399b14143a3ef5e6df529bbb1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 729c8cbb3d1440e5830542b274c181ea, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting e3466361414946c9886fdb0876d6acb1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 9c1746ccc4da49bfb6ced2fc7af962fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting c9f4df15021e460691dcb840509bc031, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 2f7aa948042241c1a7bfc8bb332ab4a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:53:49,898 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting be99281d571b4109a8c8120d1206c592, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:53:49,899 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 9a0c5a15590e4b7a8eb410340be604ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:53:49,899 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 0a6d7d5996c64b728116976060f8125c_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:53:49,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:49,901 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:49,903 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601016df6e259135e438e99090620efb5339f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601016df6e259135e438e99090620efb5339f 2023-11-12 00:53:49,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033865160f1a574a1e94bc02dfcf9364f3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033865160f1a574a1e94bc02dfcf9364f3 2023-11-12 00:53:49,905 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-12 00:53:49,905 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-12 00:53:49,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:49,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:49,940 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] throttle.PressureAwareThroughputController(145): 263a67b07df9665bc258d032dba0f4e6#family1#compaction#22 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:53:50,758 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/8b6cc35765f9491faa26ed76a14bbe81 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/8b6cc35765f9491faa26ed76a14bbe81 2023-11-12 00:53:50,761 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123196f0e249e83f401f97921339fb52e396 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123196f0e249e83f401f97921339fb52e396 2023-11-12 00:53:50,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:50,764 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 263a67b07df9665bc258d032dba0f4e6/family1 of 263a67b07df9665bc258d032dba0f4e6 into 8b6cc35765f9491faa26ed76a14bbe81(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:53:50,764 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:50,764 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699750429897; duration=0sec 2023-11-12 00:53:50,764 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:50,789 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cb04bb861cd24503a56498a9d98e0dfa first=Optional[r1] last=Optional[r4] 2023-11-12 00:53:50,790 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cb04bb861cd24503a56498a9d98e0dfa}] 2023-11-12 00:53:50,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cb04bb861cd24503a56498a9d98e0dfa for inclusion in 263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:50,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-12 00:53:50,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:53:50,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:50,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/cb04bb861cd24503a56498a9d98e0dfa to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__om7fb63kmtgcrtk3gjae6kgq4q1p7ujjdu23k6hj7tkh1us7fqisibcq5249jp60/family1/cb04bb861cd24503a56498a9d98e0dfa 2023-11-12 00:53:50,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__om7fb63kmtgcrtk3gjae6kgq4q1p7ujjdu23k6hj7tkh1us7fqisibcq5249jp60/family1/cb04bb861cd24503a56498a9d98e0dfa as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_ 2023-11-12 00:53:50,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__om7fb63kmtgcrtk3gjae6kgq4q1p7ujjdu23k6hj7tkh1us7fqisibcq5249jp60/family1/cb04bb861cd24503a56498a9d98e0dfa into 263a67b07df9665bc258d032dba0f4e6/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_ - updating store file list. 2023-11-12 00:53:50,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_ into 263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:50,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__om7fb63kmtgcrtk3gjae6kgq4q1p7ujjdu23k6hj7tkh1us7fqisibcq5249jp60/family1/cb04bb861cd24503a56498a9d98e0dfa into 263a67b07df9665bc258d032dba0f4e6/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_) 2023-11-12 00:53:50,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__om7fb63kmtgcrtk3gjae6kgq4q1p7ujjdu23k6hj7tkh1us7fqisibcq5249jp60/family1/cb04bb861cd24503a56498a9d98e0dfa 2023-11-12 00:53:50,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:53:50,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:53:50,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 263a67b07df9665bc258d032dba0f4e6/family1 is initiating minor compaction (all files) 2023-11-12 00:53:50,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@16ea614f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:50,805 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 263a67b07df9665bc258d032dba0f4e6/family1 in testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:53:50,805 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/647f271224644202bb14061a0e49ccc3, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/8b6cc35765f9491faa26ed76a14bbe81, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp, totalSize=178.1 K 2023-11-12 00:53:50,806 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 647f271224644202bb14061a0e49ccc3, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:53:50,806 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 8b6cc35765f9491faa26ed76a14bbe81, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:53:50,807 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 2a9e846b379143299c965d8d65e265bd_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223723 2023-11-12 00:53:50,807 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:50,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:50,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120156b3b6b07a3c4fd8b8dffc11343bb699 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120156b3b6b07a3c4fd8b8dffc11343bb699 2023-11-12 00:53:50,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205aafeba6fadf348cb888304dddb6c26e6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205aafeba6fadf348cb888304dddb6c26e6 2023-11-12 00:53:50,816 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282e30492977c849f8a1c9b9016fcd4bdd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512282e30492977c849f8a1c9b9016fcd4bdd 2023-11-12 00:53:50,817 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123135597bdec541457c80d38da95e75337e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123135597bdec541457c80d38da95e75337e 2023-11-12 00:53:50,818 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-12 00:53:50,818 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-12 00:53:50,818 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:50,818 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:50,826 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 263a67b07df9665bc258d032dba0f4e6#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:53:50,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/3f1db7cc7b21492a947ca1cf25bfe638, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/b2673d5399b14143a3ef5e6df529bbb1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/729c8cbb3d1440e5830542b274c181ea, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/e3466361414946c9886fdb0876d6acb1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9c1746ccc4da49bfb6ced2fc7af962fd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c9f4df15021e460691dcb840509bc031, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2f7aa948042241c1a7bfc8bb332ab4a2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/be99281d571b4109a8c8120d1206c592, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9a0c5a15590e4b7a8eb410340be604ed, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_] to archive 2023-11-12 00:53:50,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:50,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/3f1db7cc7b21492a947ca1cf25bfe638 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/3f1db7cc7b21492a947ca1cf25bfe638 2023-11-12 00:53:50,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/b2673d5399b14143a3ef5e6df529bbb1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/b2673d5399b14143a3ef5e6df529bbb1 2023-11-12 00:53:50,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/729c8cbb3d1440e5830542b274c181ea to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/729c8cbb3d1440e5830542b274c181ea 2023-11-12 00:53:50,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/e3466361414946c9886fdb0876d6acb1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/e3466361414946c9886fdb0876d6acb1 2023-11-12 00:53:50,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9c1746ccc4da49bfb6ced2fc7af962fd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9c1746ccc4da49bfb6ced2fc7af962fd 2023-11-12 00:53:50,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c9f4df15021e460691dcb840509bc031 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c9f4df15021e460691dcb840509bc031 2023-11-12 00:53:50,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2f7aa948042241c1a7bfc8bb332ab4a2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2f7aa948042241c1a7bfc8bb332ab4a2 2023-11-12 00:53:50,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/be99281d571b4109a8c8120d1206c592 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/be99281d571b4109a8c8120d1206c592 2023-11-12 00:53:50,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9a0c5a15590e4b7a8eb410340be604ed to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/9a0c5a15590e4b7a8eb410340be604ed 2023-11-12 00:53:50,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/0a6d7d5996c64b728116976060f8125c_SeqId_44_ 2023-11-12 00:53:51,704 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b3fbbc975bfa4cef9d3967c45e4225a1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b3fbbc975bfa4cef9d3967c45e4225a1 2023-11-12 00:53:51,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:51,733 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f428642cfd3041759d90b9f9cd10be3a first=Optional[r00] last=Optional[r8] 2023-11-12 00:53:51,734 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f428642cfd3041759d90b9f9cd10be3a}] 2023-11-12 00:53:51,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f428642cfd3041759d90b9f9cd10be3a for inclusion in 263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:51,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-12 00:53:51,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:53:51,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:51,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f428642cfd3041759d90b9f9cd10be3a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__li6ajr0i94k35c9bedkh3ddhelkm1doii0i7hdccm5tb7rge32rle6bn7o9kul6r/family1/f428642cfd3041759d90b9f9cd10be3a 2023-11-12 00:53:51,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__li6ajr0i94k35c9bedkh3ddhelkm1doii0i7hdccm5tb7rge32rle6bn7o9kul6r/family1/f428642cfd3041759d90b9f9cd10be3a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/7c255111c1434cceb72e8c79588912ce_SeqId_49_ 2023-11-12 00:53:51,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__li6ajr0i94k35c9bedkh3ddhelkm1doii0i7hdccm5tb7rge32rle6bn7o9kul6r/family1/f428642cfd3041759d90b9f9cd10be3a into 263a67b07df9665bc258d032dba0f4e6/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/7c255111c1434cceb72e8c79588912ce_SeqId_49_ - updating store file list. 2023-11-12 00:53:51,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/7c255111c1434cceb72e8c79588912ce_SeqId_49_ into 263a67b07df9665bc258d032dba0f4e6/family1 2023-11-12 00:53:51,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__li6ajr0i94k35c9bedkh3ddhelkm1doii0i7hdccm5tb7rge32rle6bn7o9kul6r/family1/f428642cfd3041759d90b9f9cd10be3a into 263a67b07df9665bc258d032dba0f4e6/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/7c255111c1434cceb72e8c79588912ce_SeqId_49_) 2023-11-12 00:53:51,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithMonthlyPolicy__li6ajr0i94k35c9bedkh3ddhelkm1doii0i7hdccm5tb7rge32rle6bn7o9kul6r/family1/f428642cfd3041759d90b9f9cd10be3a 2023-11-12 00:53:51,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:51,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:51,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511205e0ca71d2a8644bab85a7fbe0b42e93a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511205e0ca71d2a8644bab85a7fbe0b42e93a 2023-11-12 00:53:51,753 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511287173bb5a335442ca8acfa9f10f2b20a6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511287173bb5a335442ca8acfa9f10f2b20a6 2023-11-12 00:53:51,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130114d4acdcf904c87a9a6ccd855d1a0fc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130114d4acdcf904c87a9a6ccd855d1a0fc 2023-11-12 00:53:51,754 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-12 00:53:51,754 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-12 00:53:51,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:51,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:51,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:53:51,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:53:51,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:53:51,755 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:53:51,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3550 sec 2023-11-12 00:53:51,867 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=259 (was 251) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:37894 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38056 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x07125198-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/c664c3140cdf4ca68a557f8dfb9bf84a java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38082 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38074 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38036 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38176 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2126735078_17 at /127.0.0.1:37970 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x07125198-SendThread(127.0.0.1:60532) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38024 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:37962 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38096 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38050 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:37926 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:38098 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60532@0x07125198 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/180040172.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x305b887f-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_259812033_17 at /127.0.0.1:37950 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2126735078_17 at /127.0.0.1:38068 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=644 (was 625) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 315), ProcessCount=171 (was 172), AvailableMemoryMB=1027 (was 1136) 2023-11-12 00:53:51,880 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=171, AvailableMemoryMB=1026 2023-11-12 00:53:51,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-12 00:53:51,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:51,885 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:53:51,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-12 00:53:51,886 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:53:51,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-12 00:53:51,888 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:51,888 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2 empty. 2023-11-12 00:53:51,889 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:51,889 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-12 00:53:51,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-12 00:53:52,066 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/.tmp/family1/c664c3140cdf4ca68a557f8dfb9bf84a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/c664c3140cdf4ca68a557f8dfb9bf84a 2023-11-12 00:53:52,072 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 263a67b07df9665bc258d032dba0f4e6/family1 of 263a67b07df9665bc258d032dba0f4e6 into c664c3140cdf4ca68a557f8dfb9bf84a(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:53:52,072 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:53:52,072 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699750430805; duration=1sec 2023-11-12 00:53:52,072 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:53:52,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/647f271224644202bb14061a0e49ccc3, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/8b6cc35765f9491faa26ed76a14bbe81, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_] to archive 2023-11-12 00:53:52,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:53:52,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/647f271224644202bb14061a0e49ccc3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/647f271224644202bb14061a0e49ccc3 2023-11-12 00:53:52,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/8b6cc35765f9491faa26ed76a14bbe81 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/8b6cc35765f9491faa26ed76a14bbe81 2023-11-12 00:53:52,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/family1/2a9e846b379143299c965d8d65e265bd_SeqId_47_ 2023-11-12 00:53:52,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-12 00:53:52,299 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-12 00:53:52,300 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 199528b795c555d406bc521af8b8efc2, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:53:52,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-12 00:53:52,707 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:52,707 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 199528b795c555d406bc521af8b8efc2, disabling compactions & flushes 2023-11-12 00:53:52,707 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:52,707 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:52,707 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. after waiting 0 ms 2023-11-12 00:53:52,707 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:52,707 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:52,707 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:52,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:53:52,711 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699750432711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750432711"}]},"ts":"1699750432711"} 2023-11-12 00:53:52,712 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:53:52,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:53:52,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750432713"}]},"ts":"1699750432713"} 2023-11-12 00:53:52,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-12 00:53:52,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=199528b795c555d406bc521af8b8efc2, ASSIGN}] 2023-11-12 00:53:52,720 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=199528b795c555d406bc521af8b8efc2, ASSIGN 2023-11-12 00:53:52,721 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=199528b795c555d406bc521af8b8efc2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:53:52,872 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=199528b795c555d406bc521af8b8efc2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:52,872 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699750432872"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750432872"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750432872"}]},"ts":"1699750432872"} 2023-11-12 00:53:52,873 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 199528b795c555d406bc521af8b8efc2, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:53:52,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-12 00:53:53,025 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:53,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:53,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 199528b795c555d406bc521af8b8efc2, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:53:53,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:53:53,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,030 INFO [StoreOpener-199528b795c555d406bc521af8b8efc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,032 DEBUG [StoreOpener-199528b795c555d406bc521af8b8efc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1 2023-11-12 00:53:53,032 DEBUG [StoreOpener-199528b795c555d406bc521af8b8efc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1 2023-11-12 00:53:53,032 INFO [StoreOpener-199528b795c555d406bc521af8b8efc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 199528b795c555d406bc521af8b8efc2 columnFamilyName family1 2023-11-12 00:53:53,034 INFO [StoreOpener-199528b795c555d406bc521af8b8efc2-1] regionserver.HStore(310): Store=199528b795c555d406bc521af8b8efc2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:53:53,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 199528b795c555d406bc521af8b8efc2 2023-11-12 00:53:53,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:53:53,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 199528b795c555d406bc521af8b8efc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66602011, jitterRate=-0.007552698254585266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:53:53,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:53,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2., pid=25, masterSystemTime=1699750433025 2023-11-12 00:53:53,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:53,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:53,043 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=199528b795c555d406bc521af8b8efc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:53,044 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699750433043"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750433043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750433043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750433043"}]},"ts":"1699750433043"} 2023-11-12 00:53:53,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-12 00:53:53,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 199528b795c555d406bc521af8b8efc2, server=jenkins-hbase4.apache.org,43681,1699750400629 in 172 msec 2023-11-12 00:53:53,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-12 00:53:53,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=199528b795c555d406bc521af8b8efc2, ASSIGN in 329 msec 2023-11-12 00:53:53,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:53:53,050 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750433050"}]},"ts":"1699750433050"} 2023-11-12 00:53:53,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-12 00:53:53,054 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:53:53,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1710 sec 2023-11-12 00:53:53,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-12 00:53:53,992 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-12 00:53:54,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:54,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,024 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:54,024 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:54,024 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:54,024 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:54,025 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,025 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,026 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:54,027 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:54,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:54,027 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,027 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:54,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,028 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,028 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:54,029 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:54,029 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:54,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:54,033 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:54,033 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:54,034 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:53:54,454 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a01a3cdad60a45f3a2de0248288689cb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130a01a3cdad60a45f3a2de0248288689cb 2023-11-12 00:53:54,858 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/e97e878be9d4470ab9e3debed10ad2b5 2023-11-12 00:53:54,864 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/e97e878be9d4470ab9e3debed10ad2b5 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/e97e878be9d4470ab9e3debed10ad2b5 2023-11-12 00:53:54,870 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/e97e878be9d4470ab9e3debed10ad2b5, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-12 00:53:54,871 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 837ms, sequenceid=5, compaction requested=false 2023-11-12 00:53:54,871 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:54,872 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:54,872 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:53:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:53:54,874 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,874 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:54,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:54,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:54,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:54,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:53:54,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62c57350[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:54,876 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:54,876 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,877 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:53:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:54,878 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,878 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:53:54,879 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:54,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:54,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:54,882 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:53:54,882 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:54,882 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:54,882 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,882 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:54,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:54,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,885 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:54,885 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,886 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:54,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:54,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,889 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,889 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:54,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-12 00:53:54,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:54,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:54,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:54,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:54,890 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:54,890 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:54,990 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:54,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:54,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:54,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:54,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,997 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:54,997 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:54,997 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:54,997 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:54,998 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,998 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:54,999 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:54,999 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:54,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:55,000 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,000 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,001 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:53:55,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:55,001 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:55,001 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:55,001 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:53:55,415 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128707bb85bf378425a84108a8767dd1f0c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128707bb85bf378425a84108a8767dd1f0c 2023-11-12 00:53:55,821 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/413f038cfcce4b5ca721b7a0d25ef699 2023-11-12 00:53:55,826 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/413f038cfcce4b5ca721b7a0d25ef699 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/413f038cfcce4b5ca721b7a0d25ef699 2023-11-12 00:53:55,831 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/413f038cfcce4b5ca721b7a0d25ef699, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:53:55,832 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 831ms, sequenceid=9, compaction requested=false 2023-11-12 00:53:55,832 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:55,832 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:55,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:55,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:55,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:53:55,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:53:55,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,838 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:55,839 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,839 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:55,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:53:55,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75618407[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:55,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:55,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,841 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,842 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:55,842 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:53:55,842 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:55,842 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,842 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:55,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:53:55,843 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:55,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:55,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:55,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:55,846 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:53:55,846 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:55,846 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:55,846 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,846 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:55,848 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,848 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,848 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:55,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:55,848 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,850 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:55,853 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:55,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:55,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,853 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,854 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:55,854 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:55,854 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:55,954 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:55,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:55,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:55,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:55,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,960 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:55,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:55,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:55,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:55,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,963 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:55,963 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:55,963 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:55,963 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,964 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,964 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:53:55,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:55,964 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:55,966 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:55,966 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:55,966 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:55,966 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:56,379 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ebc9e25181d24db9b170c487d5ac1818 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ebc9e25181d24db9b170c487d5ac1818 2023-11-12 00:53:56,785 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/98c985d82b404d7988e6c8ad23d18468 2023-11-12 00:53:56,792 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/98c985d82b404d7988e6c8ad23d18468 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/98c985d82b404d7988e6c8ad23d18468 2023-11-12 00:53:56,796 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/98c985d82b404d7988e6c8ad23d18468, entries=1, sequenceid=13, filesize=4.9 K 2023-11-12 00:53:56,797 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 831ms, sequenceid=13, compaction requested=true 2023-11-12 00:53:56,797 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:56,797 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:56,797 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:56,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:56,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:53:56,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:53:56,799 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,799 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:56,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:56,800 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,800 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:56,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:56,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:56,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:56,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:53:56,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4179c9c2[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:56,801 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:56,801 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,802 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,803 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:56,803 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:53:56,803 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:56,803 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,803 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:56,806 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:53:56,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:56,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:56,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:56,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:53:56,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:56,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:56,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:56,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:56,808 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:53:56,808 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:56,808 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:56,808 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,808 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:56,810 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,810 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:56,810 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:56,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:56,811 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:56,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:56,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:56,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:56,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,814 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,814 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,814 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:56,814 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:56,815 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:56,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:56,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:56,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:56,815 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,814 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:56,815 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,815 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,815 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,815 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:56,815 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:56,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:56,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:56,915 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:56,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:56,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:56,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:56,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,922 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:56,922 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:56,922 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:56,922 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:56,923 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,923 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,924 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,924 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:56,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:56,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:56,924 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:56,924 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:56,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,926 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:53:56,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:56,926 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:56,926 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:56,926 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:56,926 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:56,926 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:56,926 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:56,926 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:56,926 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:57,343 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cb3a29525c0e4aec89fe6de53073929a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb3a29525c0e4aec89fe6de53073929a 2023-11-12 00:53:57,749 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/a55ac104a9f846d59044c06674082340 2023-11-12 00:53:57,754 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/a55ac104a9f846d59044c06674082340 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/a55ac104a9f846d59044c06674082340 2023-11-12 00:53:57,759 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/a55ac104a9f846d59044c06674082340, entries=1, sequenceid=17, filesize=4.9 K 2023-11-12 00:53:57,760 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 834ms, sequenceid=17, compaction requested=true 2023-11-12 00:53:57,760 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:57,760 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:53:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:53:57,768 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:57,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:57,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:53:57,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16e00ab7[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:57,770 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:57,770 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,771 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,771 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:57,771 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:53:57,771 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:57,771 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,771 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:57,773 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,773 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:53:57,773 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:57,773 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:53:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:57,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:57,775 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:53:57,775 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:57,775 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:57,775 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,775 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:57,777 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,777 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:57,777 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:57,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:57,778 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:57,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,779 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,789 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,789 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:57,789 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:57,789 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:57,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:57,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:57,789 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:57,789 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:57,790 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,790 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,790 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,790 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:57,790 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:57,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:57,790 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:57,890 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:57,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:57,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:57,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,897 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:57,897 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:57,897 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:57,897 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:57,898 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,898 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,899 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:57,899 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:57,900 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:57,900 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:57,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:57,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,901 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:53:57,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:57,901 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:57,901 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:57,901 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:57,901 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:58,315 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228edee282dcd59485fba92f8735ea37c14 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228edee282dcd59485fba92f8735ea37c14 2023-11-12 00:53:58,558 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:53:58,721 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/865045bfdd7349ffac555cb163a4be01 2023-11-12 00:53:58,727 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/865045bfdd7349ffac555cb163a4be01 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/865045bfdd7349ffac555cb163a4be01 2023-11-12 00:53:58,732 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/865045bfdd7349ffac555cb163a4be01, entries=1, sequenceid=21, filesize=4.9 K 2023-11-12 00:53:58,733 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 832ms, sequenceid=21, compaction requested=true 2023-11-12 00:53:58,733 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:58,733 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:53:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:53:58,735 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:58,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:53:58,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f76a4c8[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:58,737 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:58,737 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,738 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:53:58,739 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:58,739 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,739 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:53:58,741 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:58,742 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:58,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:58,744 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:53:58,744 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:58,744 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:58,744 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,744 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:58,746 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,746 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:58,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:58,746 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:58,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:58,747 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,766 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:53:58,766 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07125198 to 127.0.0.1:60532 2023-11-12 00:53:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,766 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:53:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:58,768 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:53:58,768 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x452ae3ab to 127.0.0.1:60532 2023-11-12 00:53:58,768 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:53:58,768 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:53:58,768 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3abfaa32 to 127.0.0.1:60532 2023-11-12 00:53:58,768 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:53:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,771 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,775 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:58,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-12 00:53:58,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:58,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:58,775 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,776 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:58,776 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:58,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:58,876 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:58,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:58,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:58,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:58,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,882 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:58,882 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:58,882 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:58,882 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:58,883 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,883 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,884 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:58,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:58,884 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:58,884 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,885 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:58,885 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:58,885 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:58,886 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:58,886 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:58,886 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:58,886 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:58,886 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:58,886 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:53:59,299 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310a80d3d76ce04cb2849b9f69e2394205 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310a80d3d76ce04cb2849b9f69e2394205 2023-11-12 00:53:59,705 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/6ebd79749468446880f62aba5228b94e 2023-11-12 00:53:59,710 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/6ebd79749468446880f62aba5228b94e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/6ebd79749468446880f62aba5228b94e 2023-11-12 00:53:59,714 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/6ebd79749468446880f62aba5228b94e, entries=1, sequenceid=25, filesize=4.9 K 2023-11-12 00:53:59,715 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 829ms, sequenceid=25, compaction requested=true 2023-11-12 00:53:59,715 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:53:59,715 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:53:59,715 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:53:59,717 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,717 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:59,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:59,718 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,718 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:59,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:53:59,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26ce429d[Count = 0] remaining members to acquire global barrier 2023-11-12 00:53:59,719 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:53:59,719 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,720 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:53:59,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:53:59,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:53:59,721 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,721 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:53:59,722 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:53:59,722 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,722 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:59,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:59,722 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:59,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:53:59,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:53:59,725 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:53:59,725 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:53:59,725 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:53:59,725 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,725 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:53:59,728 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,728 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:53:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:53:59,728 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:53:59,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:59,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:53:59,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,730 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:53:59,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:53:59,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:59,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:53:59,732 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:53:59,732 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:59,733 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,733 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:53:59,733 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:53:59,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:53:59,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:53:59,833 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:53:59,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:53:59,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:53:59,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:53:59,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,840 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:53:59,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:59,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:53:59,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:53:59,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:53:59,842 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:53:59,842 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:53:59,842 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,843 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:53:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:53:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:53:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:53:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:53:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:53:59,844 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:53:59,844 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:53:59,844 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:00,257 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019112e459c7c74b1e8a86db0648c32a8a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019112e459c7c74b1e8a86db0648c32a8a 2023-11-12 00:54:00,662 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/4c77349e369d414788efc7fc4fd1830c 2023-11-12 00:54:00,668 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/4c77349e369d414788efc7fc4fd1830c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/4c77349e369d414788efc7fc4fd1830c 2023-11-12 00:54:00,672 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/4c77349e369d414788efc7fc4fd1830c, entries=1, sequenceid=29, filesize=4.9 K 2023-11-12 00:54:00,673 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 829ms, sequenceid=29, compaction requested=true 2023-11-12 00:54:00,673 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:00,673 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:00,673 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:00,673 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:00,673 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,673 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:00,673 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:00,675 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,675 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:00,675 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,675 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:00,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:00,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2976a85f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:00,677 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:00,677 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,680 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:00,680 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:00,680 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,680 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:00,684 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:00,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:00,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:00,684 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:00,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:00,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:00,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:00,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:00,687 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:00,687 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:00,687 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:00,687 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,687 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:00,688 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,688 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:00,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,688 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:00,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:00,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:00,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,690 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:00,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:00,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:00,694 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:00,695 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:00,694 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,695 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,695 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,795 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:00,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:00,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:00,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:00,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,802 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:00,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:00,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:00,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:00,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,804 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,804 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:00,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:00,804 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:00,804 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,805 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:00,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:00,806 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:00,806 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:00,806 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:54:00,806 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:01,220 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b064a60f354e4df18d19666a92214615 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103b064a60f354e4df18d19666a92214615 2023-11-12 00:54:01,625 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/ebc2f85fcac7479a9f4bca7d0c2227bc 2023-11-12 00:54:01,630 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/ebc2f85fcac7479a9f4bca7d0c2227bc as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/ebc2f85fcac7479a9f4bca7d0c2227bc 2023-11-12 00:54:01,635 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/ebc2f85fcac7479a9f4bca7d0c2227bc, entries=1, sequenceid=33, filesize=4.9 K 2023-11-12 00:54:01,636 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 830ms, sequenceid=33, compaction requested=true 2023-11-12 00:54:01,636 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:01,636 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:01,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:01,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:01,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:01,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:01,638 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:01,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:01,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:01,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:01,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:01,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:01,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:01,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fd5ba74[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:01,640 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:01,640 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,641 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,641 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:01,641 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:01,641 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:01,641 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,641 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:01,644 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:01,644 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,644 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:01,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:01,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:01,644 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:01,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:01,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:01,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:01,646 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:01,646 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:01,646 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:01,646 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,646 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:01,648 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,648 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,648 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:01,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:01,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,649 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:01,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:01,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:01,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,650 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,652 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,652 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,652 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:01,652 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:01,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:01,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-12 00:54:01,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,652 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:01,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:01,652 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:01,653 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:01,653 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:01,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:01,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,753 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:01,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:01,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:01,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:01,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,759 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:01,759 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:01,760 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:01,760 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:01,760 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,760 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,761 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,761 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:01,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:01,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:01,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,762 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:01,763 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:01,763 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:54:01,763 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:02,176 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076f22ec9038aa4649a67e8656bddde164 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509076f22ec9038aa4649a67e8656bddde164 2023-11-12 00:54:02,582 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/723291f7596147a9baf98353dea9eea0 2023-11-12 00:54:02,587 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/723291f7596147a9baf98353dea9eea0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/723291f7596147a9baf98353dea9eea0 2023-11-12 00:54:02,592 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/723291f7596147a9baf98353dea9eea0, entries=1, sequenceid=37, filesize=4.9 K 2023-11-12 00:54:02,593 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 830ms, sequenceid=37, compaction requested=true 2023-11-12 00:54:02,593 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:02,593 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:02,593 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:02,593 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:02,593 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,593 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:02,593 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:02,596 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:02,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:02,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:02,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55ef19a2[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:02,598 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:02,598 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,599 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,599 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:02,599 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:02,599 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:02,599 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,599 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:02,601 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:02,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:02,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:02,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:02,603 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:02,603 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:02,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:02,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,604 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:02,605 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,605 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:02,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:02,605 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:02,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:02,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:02,606 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:02,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:02,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,607 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:02,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:02,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:02,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:02,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:02,610 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,611 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:02,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:02,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:02,611 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:02,611 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,611 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,711 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:02,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:02,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:02,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:02,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,717 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:02,717 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:02,717 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:02,717 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:02,718 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,718 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,719 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:02,719 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:02,719 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:02,719 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,720 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:02,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:02,721 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:02,721 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. started... 2023-11-12 00:54:02,721 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 199528b795c555d406bc521af8b8efc2 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:03,134 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205a0cc2f9c85c4cb799cf62c5af85a4e7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511205a0cc2f9c85c4cb799cf62c5af85a4e7 2023-11-12 00:54:03,540 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/983c9c7cf2824d16adc386bcb149b6c4 2023-11-12 00:54:03,545 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/983c9c7cf2824d16adc386bcb149b6c4 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/983c9c7cf2824d16adc386bcb149b6c4 2023-11-12 00:54:03,550 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/983c9c7cf2824d16adc386bcb149b6c4, entries=1, sequenceid=41, filesize=4.9 K 2023-11-12 00:54:03,551 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 199528b795c555d406bc521af8b8efc2 in 830ms, sequenceid=41, compaction requested=true 2023-11-12 00:54:03,551 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:03,551 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:03,551 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:03,551 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:03,551 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,551 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:03,551 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:03,556 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,556 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:03,556 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,556 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:03,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:03,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:03,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:03,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1617328[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:03,557 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:03,557 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,560 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,560 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:03,560 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:03,560 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:03,560 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,560 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:03,561 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:03,561 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,561 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:03,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,561 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:03,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:03,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:03,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:03,564 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:03,564 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:03,564 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:03,564 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,564 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:03,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:03,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:03,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:03,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:03,567 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:03,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,568 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:03,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,570 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,570 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,571 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:03,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:03,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:03,571 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:03,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:03,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:03,672 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:03,674 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-12 00:54:03,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:54:03,676 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:54:03,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:03,677 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751043677 2023-11-12 00:54:03,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-12 00:54:03,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-12 00:54:03,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:03,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x373c3084 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:03,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc84e6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:03,688 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,532 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fe5fb8faad2b44f298d4a282a820e0de to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fe5fb8faad2b44f298d4a282a820e0de 2023-11-12 00:54:04,533 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:04,546 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:04,547 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:04,553 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:04,556 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:04,566 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/546a72ad252e47528572f6e845679037 first=Optional[r3] last=Optional[r6] 2023-11-12 00:54:04,567 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/546a72ad252e47528572f6e845679037}] 2023-11-12 00:54:04,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/546a72ad252e47528572f6e845679037 for inclusion in 199528b795c555d406bc521af8b8efc2/family1 2023-11-12 00:54:04,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-12 00:54:04,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:04,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:04,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/546a72ad252e47528572f6e845679037 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pm4n3r0qhrr068d57g2nrdlusqlb1o118qir32eno2nhfbl8r79l7acldndqnh8m/family1/546a72ad252e47528572f6e845679037 2023-11-12 00:54:04,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pm4n3r0qhrr068d57g2nrdlusqlb1o118qir32eno2nhfbl8r79l7acldndqnh8m/family1/546a72ad252e47528572f6e845679037 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_ 2023-11-12 00:54:04,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pm4n3r0qhrr068d57g2nrdlusqlb1o118qir32eno2nhfbl8r79l7acldndqnh8m/family1/546a72ad252e47528572f6e845679037 into 199528b795c555d406bc521af8b8efc2/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_ - updating store file list. 2023-11-12 00:54:04,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_ into 199528b795c555d406bc521af8b8efc2/family1 2023-11-12 00:54:04,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pm4n3r0qhrr068d57g2nrdlusqlb1o118qir32eno2nhfbl8r79l7acldndqnh8m/family1/546a72ad252e47528572f6e845679037 into 199528b795c555d406bc521af8b8efc2/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_) 2023-11-12 00:54:04,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pm4n3r0qhrr068d57g2nrdlusqlb1o118qir32eno2nhfbl8r79l7acldndqnh8m/family1/546a72ad252e47528572f6e845679037 2023-11-12 00:54:04,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:54:04,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:54:04,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 199528b795c555d406bc521af8b8efc2/family1 is initiating minor compaction 2023-11-12 00:54:04,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b1bded7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:04,587 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 199528b795c555d406bc521af8b8efc2/family1 in testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:04,587 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/413f038cfcce4b5ca721b7a0d25ef699, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/98c985d82b404d7988e6c8ad23d18468, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/a55ac104a9f846d59044c06674082340, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/865045bfdd7349ffac555cb163a4be01, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/6ebd79749468446880f62aba5228b94e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/4c77349e369d414788efc7fc4fd1830c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/ebc2f85fcac7479a9f4bca7d0c2227bc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/723291f7596147a9baf98353dea9eea0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/983c9c7cf2824d16adc386bcb149b6c4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp, totalSize=50.0 K 2023-11-12 00:54:04,587 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 413f038cfcce4b5ca721b7a0d25ef699, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:54:04,587 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 98c985d82b404d7988e6c8ad23d18468, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:54:04,587 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting a55ac104a9f846d59044c06674082340, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:54:04,587 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 865045bfdd7349ffac555cb163a4be01, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:54:04,587 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 6ebd79749468446880f62aba5228b94e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:54:04,587 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 4c77349e369d414788efc7fc4fd1830c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:54:04,588 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting ebc2f85fcac7479a9f4bca7d0c2227bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:54:04,588 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 723291f7596147a9baf98353dea9eea0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:54:04,588 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 983c9c7cf2824d16adc386bcb149b6c4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:54:04,588 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:54:04,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:04,590 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:04,592 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228edee282dcd59485fba92f8735ea37c14 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228edee282dcd59485fba92f8735ea37c14 2023-11-12 00:54:04,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310a80d3d76ce04cb2849b9f69e2394205 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512310a80d3d76ce04cb2849b9f69e2394205 2023-11-12 00:54:04,594 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019112e459c7c74b1e8a86db0648c32a8a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019112e459c7c74b1e8a86db0648c32a8a 2023-11-12 00:54:04,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103b064a60f354e4df18d19666a92214615 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103b064a60f354e4df18d19666a92214615 2023-11-12 00:54:04,596 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-12 00:54:04,596 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-12 00:54:04,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,597 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:04,627 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 199528b795c555d406bc521af8b8efc2#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:54:05,437 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051b1318172a714618a42f368cd16d2c0f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051b1318172a714618a42f368cd16d2c0f 2023-11-12 00:54:05,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:05,442 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/bb1b7d735af34c309adabbefb50d421e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/bb1b7d735af34c309adabbefb50d421e 2023-11-12 00:54:05,447 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 199528b795c555d406bc521af8b8efc2/family1 of 199528b795c555d406bc521af8b8efc2 into bb1b7d735af34c309adabbefb50d421e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:54:05,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:05,448 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699750444587; duration=0sec 2023-11-12 00:54:05,448 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:05,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/413f038cfcce4b5ca721b7a0d25ef699, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/98c985d82b404d7988e6c8ad23d18468, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/a55ac104a9f846d59044c06674082340, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/865045bfdd7349ffac555cb163a4be01, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/6ebd79749468446880f62aba5228b94e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/4c77349e369d414788efc7fc4fd1830c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/ebc2f85fcac7479a9f4bca7d0c2227bc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/723291f7596147a9baf98353dea9eea0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/983c9c7cf2824d16adc386bcb149b6c4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_] to archive 2023-11-12 00:54:05,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:05,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/72a92f1ad3f24a6c9078cc364dae7712 first=Optional[r1] last=Optional[r2] 2023-11-12 00:54:05,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/72a92f1ad3f24a6c9078cc364dae7712}] 2023-11-12 00:54:05,476 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/413f038cfcce4b5ca721b7a0d25ef699 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/413f038cfcce4b5ca721b7a0d25ef699 2023-11-12 00:54:05,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/72a92f1ad3f24a6c9078cc364dae7712 for inclusion in 199528b795c555d406bc521af8b8efc2/family1 2023-11-12 00:54:05,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/98c985d82b404d7988e6c8ad23d18468 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/98c985d82b404d7988e6c8ad23d18468 2023-11-12 00:54:05,479 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/a55ac104a9f846d59044c06674082340 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/a55ac104a9f846d59044c06674082340 2023-11-12 00:54:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-12 00:54:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:05,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/865045bfdd7349ffac555cb163a4be01 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/865045bfdd7349ffac555cb163a4be01 2023-11-12 00:54:05,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:05,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/72a92f1ad3f24a6c9078cc364dae7712 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rg4gt1il1g4mimp03n7qbr3ca4mj2p357eaccok1iecvph9977suu4o811serbg2/family1/72a92f1ad3f24a6c9078cc364dae7712 2023-11-12 00:54:05,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/6ebd79749468446880f62aba5228b94e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/6ebd79749468446880f62aba5228b94e 2023-11-12 00:54:05,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/4c77349e369d414788efc7fc4fd1830c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/4c77349e369d414788efc7fc4fd1830c 2023-11-12 00:54:05,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rg4gt1il1g4mimp03n7qbr3ca4mj2p357eaccok1iecvph9977suu4o811serbg2/family1/72a92f1ad3f24a6c9078cc364dae7712 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_ 2023-11-12 00:54:05,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rg4gt1il1g4mimp03n7qbr3ca4mj2p357eaccok1iecvph9977suu4o811serbg2/family1/72a92f1ad3f24a6c9078cc364dae7712 into 199528b795c555d406bc521af8b8efc2/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_ - updating store file list. 2023-11-12 00:54:05,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/ebc2f85fcac7479a9f4bca7d0c2227bc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/ebc2f85fcac7479a9f4bca7d0c2227bc 2023-11-12 00:54:05,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/723291f7596147a9baf98353dea9eea0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/723291f7596147a9baf98353dea9eea0 2023-11-12 00:54:05,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/983c9c7cf2824d16adc386bcb149b6c4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/983c9c7cf2824d16adc386bcb149b6c4 2023-11-12 00:54:05,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_ into 199528b795c555d406bc521af8b8efc2/family1 2023-11-12 00:54:05,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rg4gt1il1g4mimp03n7qbr3ca4mj2p357eaccok1iecvph9977suu4o811serbg2/family1/72a92f1ad3f24a6c9078cc364dae7712 into 199528b795c555d406bc521af8b8efc2/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_) 2023-11-12 00:54:05,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/588a8b04924149f184c9bf78a7c2ca8d_SeqId_44_ 2023-11-12 00:54:05,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithWeeklyPolicy__rg4gt1il1g4mimp03n7qbr3ca4mj2p357eaccok1iecvph9977suu4o811serbg2/family1/72a92f1ad3f24a6c9078cc364dae7712 2023-11-12 00:54:05,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:54:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:54:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 199528b795c555d406bc521af8b8efc2/family1 is initiating minor compaction (all files) 2023-11-12 00:54:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@32540cd2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:05,491 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 199528b795c555d406bc521af8b8efc2/family1 in testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:54:05,491 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/e97e878be9d4470ab9e3debed10ad2b5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/bb1b7d735af34c309adabbefb50d421e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp, totalSize=176.8 K 2023-11-12 00:54:05,492 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting e97e878be9d4470ab9e3debed10ad2b5, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:54:05,492 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting bb1b7d735af34c309adabbefb50d421e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:54:05,493 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223723 2023-11-12 00:54:05,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:05,494 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:05,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ebc9e25181d24db9b170c487d5ac1818 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ebc9e25181d24db9b170c487d5ac1818 2023-11-12 00:54:05,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb3a29525c0e4aec89fe6de53073929a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205cb3a29525c0e4aec89fe6de53073929a 2023-11-12 00:54:05,497 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-12 00:54:05,497 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-12 00:54:05,498 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:05,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:05,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:05,499 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:54:05,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8250 sec 2023-11-12 00:54:05,511 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 199528b795c555d406bc521af8b8efc2#family1#compaction#35 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:54:05,597 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254 (was 259), OpenFileDescriptor=617 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 274), ProcessCount=171 (was 171), AvailableMemoryMB=935 (was 1026) 2023-11-12 00:54:05,607 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=254, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=171, AvailableMemoryMB=934 2023-11-12 00:54:05,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-12 00:54:05,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:05,612 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:54:05,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-12 00:54:05,613 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:54:05,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-12 00:54:05,614 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:05,614 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:05,615 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:05,615 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243 empty. 2023-11-12 00:54:05,615 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63 empty. 2023-11-12 00:54:05,615 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116 empty. 2023-11-12 00:54:05,615 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:05,616 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:05,616 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:05,616 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-12 00:54:05,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-12 00:54:05,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-12 00:54:06,024 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:06,025 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 247448b82bf56bb9cbb3264a90f27243, NAME => 'testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:06,025 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => e854e8483a90d8411db6a37134b33b63, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:06,025 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec395e4117e03f35cc9abdba56a76116, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:06,036 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:06,036 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing e854e8483a90d8411db6a37134b33b63, disabling compactions & flushes 2023-11-12 00:54:06,036 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,036 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,036 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. after waiting 0 ms 2023-11-12 00:54:06,036 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,036 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,036 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:54:06,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-12 00:54:06,435 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 247448b82bf56bb9cbb3264a90f27243, disabling compactions & flushes 2023-11-12 00:54:06,436 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. after waiting 0 ms 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,436 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 247448b82bf56bb9cbb3264a90f27243: 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing ec395e4117e03f35cc9abdba56a76116, disabling compactions & flushes 2023-11-12 00:54:06,436 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. after waiting 0 ms 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,436 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,436 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for ec395e4117e03f35cc9abdba56a76116: 2023-11-12 00:54:06,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:54:06,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699750446439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750446439"}]},"ts":"1699750446439"} 2023-11-12 00:54:06,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699750446439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750446439"}]},"ts":"1699750446439"} 2023-11-12 00:54:06,440 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699750446439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750446439"}]},"ts":"1699750446439"} 2023-11-12 00:54:06,442 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-12 00:54:06,443 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:54:06,443 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750446443"}]},"ts":"1699750446443"} 2023-11-12 00:54:06,445 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-12 00:54:06,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=247448b82bf56bb9cbb3264a90f27243, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec395e4117e03f35cc9abdba56a76116, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e854e8483a90d8411db6a37134b33b63, ASSIGN}] 2023-11-12 00:54:06,450 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e854e8483a90d8411db6a37134b33b63, ASSIGN 2023-11-12 00:54:06,450 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec395e4117e03f35cc9abdba56a76116, ASSIGN 2023-11-12 00:54:06,450 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=247448b82bf56bb9cbb3264a90f27243, ASSIGN 2023-11-12 00:54:06,451 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e854e8483a90d8411db6a37134b33b63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:06,451 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec395e4117e03f35cc9abdba56a76116, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:06,451 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=247448b82bf56bb9cbb3264a90f27243, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:06,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ec395e4117e03f35cc9abdba56a76116, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,603 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=247448b82bf56bb9cbb3264a90f27243, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,603 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=e854e8483a90d8411db6a37134b33b63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,603 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699750446603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750446603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750446603"}]},"ts":"1699750446603"} 2023-11-12 00:54:06,603 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699750446603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750446603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750446603"}]},"ts":"1699750446603"} 2023-11-12 00:54:06,603 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699750446603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750446603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750446603"}]},"ts":"1699750446603"} 2023-11-12 00:54:06,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure ec395e4117e03f35cc9abdba56a76116, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:06,605 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 247448b82bf56bb9cbb3264a90f27243, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:06,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure e854e8483a90d8411db6a37134b33b63, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-12 00:54:06,732 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/.tmp/family1/67e900cff612427f95a127e232d51e5d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/67e900cff612427f95a127e232d51e5d 2023-11-12 00:54:06,737 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 199528b795c555d406bc521af8b8efc2/family1 of 199528b795c555d406bc521af8b8efc2 into 67e900cff612427f95a127e232d51e5d(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:54:06,737 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:54:06,737 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1699750445491; duration=1sec 2023-11-12 00:54:06,737 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:06,756 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec395e4117e03f35cc9abdba56a76116, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.', STARTKEY => '1', ENDKEY => '2'} 2023-11-12 00:54:06,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/e97e878be9d4470ab9e3debed10ad2b5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/bb1b7d735af34c309adabbefb50d421e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_] to archive 2023-11-12 00:54:06,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:06,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:06,763 INFO [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/e97e878be9d4470ab9e3debed10ad2b5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/e97e878be9d4470ab9e3debed10ad2b5 2023-11-12 00:54:06,764 DEBUG [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116/family1 2023-11-12 00:54:06,764 DEBUG [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116/family1 2023-11-12 00:54:06,764 INFO [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec395e4117e03f35cc9abdba56a76116 columnFamilyName family1 2023-11-12 00:54:06,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/bb1b7d735af34c309adabbefb50d421e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/bb1b7d735af34c309adabbefb50d421e 2023-11-12 00:54:06,766 INFO [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] regionserver.HStore(310): Store=ec395e4117e03f35cc9abdba56a76116/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:06,766 INFO [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/family1/d0cdb0095eb3445d8a7655dfeeb85328_SeqId_47_ 2023-11-12 00:54:06,767 DEBUG [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116/family2 2023-11-12 00:54:06,767 DEBUG [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116/family2 2023-11-12 00:54:06,768 INFO [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec395e4117e03f35cc9abdba56a76116 columnFamilyName family2 2023-11-12 00:54:06,769 INFO [StoreOpener-ec395e4117e03f35cc9abdba56a76116-1] regionserver.HStore(310): Store=ec395e4117e03f35cc9abdba56a76116/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:06,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:54:06,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:54:06,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:06,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec395e4117e03f35cc9abdba56a76116; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63536277, jitterRate=-0.05323569476604462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:54:06,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec395e4117e03f35cc9abdba56a76116: 2023-11-12 00:54:06,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116., pid=31, masterSystemTime=1699750446756 2023-11-12 00:54:06,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:06,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e854e8483a90d8411db6a37134b33b63, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.', STARTKEY => '2', ENDKEY => ''} 2023-11-12 00:54:06,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:06,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,778 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ec395e4117e03f35cc9abdba56a76116, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699750446778"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750446778"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750446778"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750446778"}]},"ts":"1699750446778"} 2023-11-12 00:54:06,779 INFO [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,780 DEBUG [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1 2023-11-12 00:54:06,780 DEBUG [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1 2023-11-12 00:54:06,781 INFO [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e854e8483a90d8411db6a37134b33b63 columnFamilyName family1 2023-11-12 00:54:06,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-11-12 00:54:06,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure ec395e4117e03f35cc9abdba56a76116, server=jenkins-hbase4.apache.org,43681,1699750400629 in 175 msec 2023-11-12 00:54:06,782 INFO [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] regionserver.HStore(310): Store=e854e8483a90d8411db6a37134b33b63/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:06,782 INFO [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,783 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=ec395e4117e03f35cc9abdba56a76116, ASSIGN in 333 msec 2023-11-12 00:54:06,784 DEBUG [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family2 2023-11-12 00:54:06,784 DEBUG [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family2 2023-11-12 00:54:06,785 INFO [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e854e8483a90d8411db6a37134b33b63 columnFamilyName family2 2023-11-12 00:54:06,785 INFO [StoreOpener-e854e8483a90d8411db6a37134b33b63-1] regionserver.HStore(310): Store=e854e8483a90d8411db6a37134b33b63/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:06,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:54:06,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e854e8483a90d8411db6a37134b33b63 2023-11-12 00:54:06,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:06,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e854e8483a90d8411db6a37134b33b63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71176977, jitterRate=0.06061960756778717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:54:06,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:54:06,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63., pid=33, masterSystemTime=1699750446756 2023-11-12 00:54:06,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:06,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 247448b82bf56bb9cbb3264a90f27243, NAME => 'testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.', STARTKEY => '', ENDKEY => '1'} 2023-11-12 00:54:06,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:06,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=e854e8483a90d8411db6a37134b33b63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,794 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699750446793"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750446793"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750446793"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750446793"}]},"ts":"1699750446793"} 2023-11-12 00:54:06,795 INFO [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,797 DEBUG [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243/family1 2023-11-12 00:54:06,797 DEBUG [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243/family1 2023-11-12 00:54:06,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-11-12 00:54:06,797 INFO [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 247448b82bf56bb9cbb3264a90f27243 columnFamilyName family1 2023-11-12 00:54:06,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure e854e8483a90d8411db6a37134b33b63, server=jenkins-hbase4.apache.org,43681,1699750400629 in 189 msec 2023-11-12 00:54:06,798 INFO [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] regionserver.HStore(310): Store=247448b82bf56bb9cbb3264a90f27243/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:06,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e854e8483a90d8411db6a37134b33b63, ASSIGN in 349 msec 2023-11-12 00:54:06,798 INFO [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,800 DEBUG [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243/family2 2023-11-12 00:54:06,800 DEBUG [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243/family2 2023-11-12 00:54:06,800 INFO [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 247448b82bf56bb9cbb3264a90f27243 columnFamilyName family2 2023-11-12 00:54:06,801 INFO [StoreOpener-247448b82bf56bb9cbb3264a90f27243-1] regionserver.HStore(310): Store=247448b82bf56bb9cbb3264a90f27243/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:06,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:54:06,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:54:06,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:06,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 247448b82bf56bb9cbb3264a90f27243; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69423724, jitterRate=0.034494102001190186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:54:06,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 247448b82bf56bb9cbb3264a90f27243: 2023-11-12 00:54:06,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243., pid=32, masterSystemTime=1699750446756 2023-11-12 00:54:06,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:06,810 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=247448b82bf56bb9cbb3264a90f27243, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:06,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699750446810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750446810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750446810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750446810"}]},"ts":"1699750446810"} 2023-11-12 00:54:06,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-11-12 00:54:06,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 247448b82bf56bb9cbb3264a90f27243, server=jenkins-hbase4.apache.org,43681,1699750400629 in 206 msec 2023-11-12 00:54:06,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-11-12 00:54:06,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=247448b82bf56bb9cbb3264a90f27243, ASSIGN in 365 msec 2023-11-12 00:54:06,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:54:06,816 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750446816"}]},"ts":"1699750446816"} 2023-11-12 00:54:06,817 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-12 00:54:06,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:54:06,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2110 sec 2023-11-12 00:54:07,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-12 00:54:07,717 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-12 00:54:07,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:07,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,726 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-12 00:54:07,726 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:07,726 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-12 00:54:07,726 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-12 00:54:07,726 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,726 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,728 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:07,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:07,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:07,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:07,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:07,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:07,729 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-12 00:54:07,729 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:07,729 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-12 00:54:07,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:07,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. started... 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec395e4117e03f35cc9abdba56a76116: 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. started... 2023-11-12 00:54:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:54:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 247448b82bf56bb9cbb3264a90f27243: 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. started... 2023-11-12 00:54:07,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:54:07,733 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e854e8483a90d8411db6a37134b33b63 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-12 00:54:07,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:07,733 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:54:08,146 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311126d3d1d3026c248f7b2177dd4e6566b5a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311126d3d1d3026c248f7b2177dd4e6566b5a 2023-11-12 00:54:08,551 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/.tmp/family1/6565e9c7d50c45b1a149410d894b44ff 2023-11-12 00:54:08,557 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/.tmp/family1/6565e9c7d50c45b1a149410d894b44ff as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/6565e9c7d50c45b1a149410d894b44ff 2023-11-12 00:54:08,561 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/6565e9c7d50c45b1a149410d894b44ff, entries=1, sequenceid=5, filesize=4.9 K 2023-11-12 00:54:08,562 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for e854e8483a90d8411db6a37134b33b63 in 828ms, sequenceid=5, compaction requested=false 2023-11-12 00:54:08,562 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-12 00:54:08,562 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:54:08,562 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:08,562 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:54:08,562 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:54:08,562 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,562 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-12 00:54:08,562 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-12 00:54:08,564 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,564 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:08,564 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,564 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-12 00:54:08,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d49070b[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:08,566 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-12 00:54:08,566 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,572 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,572 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-12 00:54:08,572 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-12 00:54:08,572 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:08,572 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,572 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:08,573 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-12 00:54:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:08,573 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,574 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-12 00:54:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:08,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:08,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-12 00:54:08,576 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-12 00:54:08,576 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:08,576 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:08,576 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,576 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:08,578 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,578 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:08,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,578 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:08,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:08,578 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:08,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,580 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-12 00:54:08,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:08,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:08,582 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:08,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:08,582 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,583 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:08,583 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,583 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:08,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:08,683 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:08,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:08,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:08,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:08,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,689 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-12 00:54:08,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:08,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-12 00:54:08,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-12 00:54:08,690 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,690 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,692 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,692 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:08,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:08,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:08,693 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:08,693 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:08,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:08,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,694 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,694 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-12 00:54:08,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-12 00:54:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-12 00:54:08,694 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:08,694 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. started... 2023-11-12 00:54:08,694 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:08,694 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec395e4117e03f35cc9abdba56a76116: 2023-11-12 00:54:08,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:08,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:54:08,694 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. started... 2023-11-12 00:54:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:54:08,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 247448b82bf56bb9cbb3264a90f27243: 2023-11-12 00:54:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:08,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. started... 2023-11-12 00:54:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:54:08,695 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e854e8483a90d8411db6a37134b33b63 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-12 00:54:08,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:54:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:54:09,107 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311120325ce6b57b1456e8cd5e26829095991 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311120325ce6b57b1456e8cd5e26829095991 2023-11-12 00:54:09,512 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/.tmp/family1/317b6fe6e4f34c99a8394aede812a596 2023-11-12 00:54:09,518 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/.tmp/family1/317b6fe6e4f34c99a8394aede812a596 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/317b6fe6e4f34c99a8394aede812a596 2023-11-12 00:54:09,523 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/317b6fe6e4f34c99a8394aede812a596, entries=2, sequenceid=9, filesize=5.0 K 2023-11-12 00:54:09,524 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for e854e8483a90d8411db6a37134b33b63 in 829ms, sequenceid=9, compaction requested=false 2023-11-12 00:54:09,524 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:54:09,524 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:09,524 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:54:09,524 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:54:09,524 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,525 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-12 00:54:09,525 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-12 00:54:09,526 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,526 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:09,527 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,527 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:09,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:09,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-12 00:54:09,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f5d08cc[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:09,528 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-12 00:54:09,528 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,530 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,530 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-12 00:54:09,530 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-12 00:54:09,530 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:09,530 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,530 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:09,531 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,531 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-12 00:54:09,531 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:09,531 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-12 00:54:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:09,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-12 00:54:09,533 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-12 00:54:09,534 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:09,534 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:09,534 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,534 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:09,539 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,539 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:09,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,539 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:09,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:09,540 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:09,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,541 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,543 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,543 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,543 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,543 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,544 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:09,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-12 00:54:09,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:09,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:09,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:09,544 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:09,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:09,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:09,644 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:09,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:09,651 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-12 00:54:09,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-12 00:54:09,654 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-12 00:54:09,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:09,655 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751049655 2023-11-12 00:54:09,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:09,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-12 00:54:09,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-12 00:54:09,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x401dc135 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:09,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59bf4c74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:09,661 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231112 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-12 00:54:10,492 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112dd53d2058ce54579a28c971cb9773c58 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231112dd53d2058ce54579a28c971cb9773c58 2023-11-12 00:54:10,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-12 00:54:10,506 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:10,507 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:10,514 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:10,516 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:10,528 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231112/family1/c567e703cc3d4146b22976c4fb916e5b first=Optional[k0] last=Optional[k1] 2023-11-12 00:54:10,528 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231112/family1/c567e703cc3d4146b22976c4fb916e5b}] 2023-11-12 00:54:10,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231112/family1/c567e703cc3d4146b22976c4fb916e5b for inclusion in e854e8483a90d8411db6a37134b33b63/family1 2023-11-12 00:54:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-12 00:54:10,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-12 00:54:10,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:54:10,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231112/family1/c567e703cc3d4146b22976c4fb916e5b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbnhrn5ervk92hs63novk39r3sj5jet0m8goivj6p91mst0k3nqfm5phekig6j4c/family1/c567e703cc3d4146b22976c4fb916e5b 2023-11-12 00:54:10,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbnhrn5ervk92hs63novk39r3sj5jet0m8goivj6p91mst0k3nqfm5phekig6j4c/family1/c567e703cc3d4146b22976c4fb916e5b as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_ 2023-11-12 00:54:10,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbnhrn5ervk92hs63novk39r3sj5jet0m8goivj6p91mst0k3nqfm5phekig6j4c/family1/c567e703cc3d4146b22976c4fb916e5b into e854e8483a90d8411db6a37134b33b63/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_ - updating store file list. 2023-11-12 00:54:10,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_ into e854e8483a90d8411db6a37134b33b63/family1 2023-11-12 00:54:10,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbnhrn5ervk92hs63novk39r3sj5jet0m8goivj6p91mst0k3nqfm5phekig6j4c/family1/c567e703cc3d4146b22976c4fb916e5b into e854e8483a90d8411db6a37134b33b63/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_) 2023-11-12 00:54:10,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testScannerOnBulkLoadRefHFiles__qbnhrn5ervk92hs63novk39r3sj5jet0m8goivj6p91mst0k3nqfm5phekig6j4c/family1/c567e703cc3d4146b22976c4fb916e5b 2023-11-12 00:54:10,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:54:10,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:54:10,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): e854e8483a90d8411db6a37134b33b63/family1 is initiating minor compaction (all files) 2023-11-12 00:54:10,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@344315b4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:10,547 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e854e8483a90d8411db6a37134b33b63/family1 in testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:54:10,547 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/6565e9c7d50c45b1a149410d894b44ff, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/317b6fe6e4f34c99a8394aede812a596, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/.tmp, totalSize=15.1 K 2023-11-12 00:54:10,548 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 6565e9c7d50c45b1a149410d894b44ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750447718 2023-11-12 00:54:10,548 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 317b6fe6e4f34c99a8394aede812a596, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750447718 2023-11-12 00:54:10,548 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750447718 2023-11-12 00:54:10,549 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-12 00:54:10,550 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:10,551 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311120325ce6b57b1456e8cd5e26829095991 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311120325ce6b57b1456e8cd5e26829095991 2023-11-12 00:54:10,553 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311126d3d1d3026c248f7b2177dd4e6566b5a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311126d3d1d3026c248f7b2177dd4e6566b5a 2023-11-12 00:54:10,553 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-12 00:54:10,553 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231112' 2023-11-12 00:54:10,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231112 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-12 00:54:10,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-12 00:54:10,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:10,554 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-12 00:54:10,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 902 msec 2023-11-12 00:54:10,562 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): e854e8483a90d8411db6a37134b33b63#family1#compaction#38 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:54:10,587 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252 (was 254), OpenFileDescriptor=621 (was 617) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 239), ProcessCount=171 (was 171), AvailableMemoryMB=933 (was 934) 2023-11-12 00:54:10,597 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=621, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=171, AvailableMemoryMB=933 2023-11-12 00:54:10,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-12 00:54:10,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:10,601 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:54:10,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-12 00:54:10,602 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:54:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-12 00:54:10,603 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:10,603 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45 empty. 2023-11-12 00:54:10,604 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:10,604 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-12 00:54:10,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-12 00:54:10,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-12 00:54:11,011 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:11,012 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => e54322db166e4083ab73da40eb699d45, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:11,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-12 00:54:11,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:11,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing e54322db166e4083ab73da40eb699d45, disabling compactions & flushes 2023-11-12 00:54:11,418 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. after waiting 0 ms 2023-11-12 00:54:11,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,418 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,418 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:11,421 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:54:11,422 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699750451421"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750451421"}]},"ts":"1699750451421"} 2023-11-12 00:54:11,423 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:54:11,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:54:11,424 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750451424"}]},"ts":"1699750451424"} 2023-11-12 00:54:11,425 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-12 00:54:11,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e54322db166e4083ab73da40eb699d45, ASSIGN}] 2023-11-12 00:54:11,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e54322db166e4083ab73da40eb699d45, ASSIGN 2023-11-12 00:54:11,431 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e54322db166e4083ab73da40eb699d45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:11,582 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e54322db166e4083ab73da40eb699d45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:11,582 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699750451582"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750451582"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750451582"}]},"ts":"1699750451582"} 2023-11-12 00:54:11,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure e54322db166e4083ab73da40eb699d45, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:11,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-12 00:54:11,735 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:11,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e54322db166e4083ab73da40eb699d45, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:11,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,740 INFO [StoreOpener-e54322db166e4083ab73da40eb699d45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,741 DEBUG [StoreOpener-e54322db166e4083ab73da40eb699d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1 2023-11-12 00:54:11,741 DEBUG [StoreOpener-e54322db166e4083ab73da40eb699d45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1 2023-11-12 00:54:11,742 INFO [StoreOpener-e54322db166e4083ab73da40eb699d45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e54322db166e4083ab73da40eb699d45 columnFamilyName family1 2023-11-12 00:54:11,743 INFO [StoreOpener-e54322db166e4083ab73da40eb699d45-1] regionserver.HStore(310): Store=e54322db166e4083ab73da40eb699d45/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e54322db166e4083ab73da40eb699d45 2023-11-12 00:54:11,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:11,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e54322db166e4083ab73da40eb699d45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69644573, jitterRate=0.03778500854969025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:11,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:11,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45., pid=37, masterSystemTime=1699750451735 2023-11-12 00:54:11,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:11,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e54322db166e4083ab73da40eb699d45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:11,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699750451752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750451752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750451752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750451752"}]},"ts":"1699750451752"} 2023-11-12 00:54:11,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-12 00:54:11,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure e54322db166e4083ab73da40eb699d45, server=jenkins-hbase4.apache.org,43681,1699750400629 in 170 msec 2023-11-12 00:54:11,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-12 00:54:11,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=e54322db166e4083ab73da40eb699d45, ASSIGN in 326 msec 2023-11-12 00:54:11,758 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:54:11,758 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750451758"}]},"ts":"1699750451758"} 2023-11-12 00:54:11,759 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-12 00:54:11,762 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:54:11,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1630 sec 2023-11-12 00:54:11,781 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/.tmp/family1/ff2675df68094092bf3a3668f6af3ea0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/ff2675df68094092bf3a3668f6af3ea0 2023-11-12 00:54:11,786 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e854e8483a90d8411db6a37134b33b63/family1 of e854e8483a90d8411db6a37134b33b63 into ff2675df68094092bf3a3668f6af3ea0(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:54:11,786 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:54:11,786 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699750450547; duration=1sec 2023-11-12 00:54:11,786 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:11,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/6565e9c7d50c45b1a149410d894b44ff, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/317b6fe6e4f34c99a8394aede812a596, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_] to archive 2023-11-12 00:54:11,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:11,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/6565e9c7d50c45b1a149410d894b44ff to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/6565e9c7d50c45b1a149410d894b44ff 2023-11-12 00:54:11,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/317b6fe6e4f34c99a8394aede812a596 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/317b6fe6e4f34c99a8394aede812a596 2023-11-12 00:54:11,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/family1/0b3423b18a554fc7bd6e77cf413533c5_SeqId_12_ 2023-11-12 00:54:12,294 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:54:12,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-12 00:54:12,707 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-12 00:54:12,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:12,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,731 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:12,731 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:12,731 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:12,731 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:12,731 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,731 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,733 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:12,733 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:12,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:12,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:12,733 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:12,733 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:12,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:12,734 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:12,734 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:12,735 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:54:12,753 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307c19d2917cd344c2b9f11f70b9ef5750 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307c19d2917cd344c2b9f11f70b9ef5750 2023-11-12 00:54:13,156 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/d5cac70bc01740ca88b15bf9dfd3e9ff 2023-11-12 00:54:13,161 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/d5cac70bc01740ca88b15bf9dfd3e9ff as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/d5cac70bc01740ca88b15bf9dfd3e9ff 2023-11-12 00:54:13,166 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/d5cac70bc01740ca88b15bf9dfd3e9ff, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-12 00:54:13,167 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 431ms, sequenceid=5, compaction requested=false 2023-11-12 00:54:13,167 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:13,167 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:13,167 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:13,167 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:13,167 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:13,167 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,167 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:13,167 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:13,169 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:13,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:13,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:13,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:13,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22d2328c[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:13,171 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,173 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,173 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:13,173 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:13,173 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:13,173 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,173 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:13,174 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:13,175 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:13,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:13,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:13,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:13,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:13,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:13,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:13,177 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:13,177 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:13,177 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:13,177 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,177 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:13,179 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,179 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:13,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:13,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,179 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:13,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:13,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:13,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:13,180 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:13,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,181 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:13,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:13,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:13,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:13,183 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,184 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,184 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:13,184 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:13,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:13,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:13,284 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:13,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:13,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:13,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,290 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:13,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:13,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:13,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:13,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,293 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:13,293 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:13,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:13,293 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:13,293 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:13,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:13,294 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:13,294 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:13,294 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:54:13,707 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282fa1f59d6b804f52b4dfb3589b544c88 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511282fa1f59d6b804f52b4dfb3589b544c88 2023-11-12 00:54:14,113 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/14a736f8e16444ec99e3c773a1122350 2023-11-12 00:54:14,118 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/14a736f8e16444ec99e3c773a1122350 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/14a736f8e16444ec99e3c773a1122350 2023-11-12 00:54:14,122 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/14a736f8e16444ec99e3c773a1122350, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:54:14,123 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 829ms, sequenceid=9, compaction requested=false 2023-11-12 00:54:14,123 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:14,123 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:14,123 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:14,124 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:14,124 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,124 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:14,124 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:14,125 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,125 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:14,126 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,126 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:14,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:14,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a0fdcd[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:14,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:14,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,128 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,128 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:14,128 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:14,128 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:14,128 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,128 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:14,129 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:14,129 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,129 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:14,130 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:14,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:14,132 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:14,132 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:14,132 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:14,132 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,132 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:14,134 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,134 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:14,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,134 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:14,135 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,136 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,141 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:14,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-12 00:54:14,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:14,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:14,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:14,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:14,142 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:14,142 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:14,142 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:14,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:14,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:14,242 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:14,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:14,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:14,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:14,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,248 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:14,248 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:14,248 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:14,248 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:14,249 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,249 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,250 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,250 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:14,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:14,250 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:14,250 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,251 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:14,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:14,251 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:14,251 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:14,251 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:14,251 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:14,251 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:14,252 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:14,252 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:14,252 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:14,663 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012ded9d4004124a6191b1dcdd8ffdc610 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512012ded9d4004124a6191b1dcdd8ffdc610 2023-11-12 00:54:15,069 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/f2af76d8dd9a4cc99f6350604afe0de9 2023-11-12 00:54:15,074 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/f2af76d8dd9a4cc99f6350604afe0de9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/f2af76d8dd9a4cc99f6350604afe0de9 2023-11-12 00:54:15,078 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/f2af76d8dd9a4cc99f6350604afe0de9, entries=1, sequenceid=13, filesize=4.9 K 2023-11-12 00:54:15,079 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 827ms, sequenceid=13, compaction requested=true 2023-11-12 00:54:15,079 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:15,079 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:15,081 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:15,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:15,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:15,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d04c68d[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:15,082 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:15,083 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,084 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:15,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:15,084 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,084 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:15,085 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,085 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:15,085 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:15,086 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:15,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:15,088 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:15,088 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:15,088 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:15,088 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,088 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:15,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:15,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:15,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:15,096 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,098 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:15,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:15,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:15,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:15,100 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:15,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,101 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:15,101 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:15,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:15,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:15,201 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:15,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:15,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:15,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:15,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,207 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:15,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:15,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:15,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:15,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,208 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:15,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:15,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:15,209 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:15,209 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:15,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:15,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,209 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:15,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:15,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:15,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:15,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:15,210 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:15,623 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051fa5926506a641e5a95d41a9258a1247 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051fa5926506a641e5a95d41a9258a1247 2023-11-12 00:54:16,028 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/1d254343ba87436e8718be7951cbe3d4 2023-11-12 00:54:16,033 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/1d254343ba87436e8718be7951cbe3d4 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1d254343ba87436e8718be7951cbe3d4 2023-11-12 00:54:16,038 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1d254343ba87436e8718be7951cbe3d4, entries=1, sequenceid=17, filesize=4.9 K 2023-11-12 00:54:16,038 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 828ms, sequenceid=17, compaction requested=true 2023-11-12 00:54:16,039 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:16,039 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:16,039 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:16,040 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,040 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,041 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:16,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:16,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:16,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a78ba89[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:16,042 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:16,042 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,046 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,046 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:16,046 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:16,046 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:16,046 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,046 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:16,047 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:16,047 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,047 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:16,047 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:16,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:16,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:16,049 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:16,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:16,050 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:16,050 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,050 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:16,051 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,051 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:16,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,051 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:16,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:16,051 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:16,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,053 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:16,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,055 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:16,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:16,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:16,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,055 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:16,056 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:16,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:16,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:16,156 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:16,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:16,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:16,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:16,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,162 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:16,162 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:16,162 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:16,162 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:16,162 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,162 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,164 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,164 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:16,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:16,165 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,165 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,166 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:16,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:16,166 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:16,166 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:16,167 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:16,578 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287f7957a6562449369d5d3783063d092d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512287f7957a6562449369d5d3783063d092d 2023-11-12 00:54:16,984 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/3a9de42a5eba46dfa5d475a7ccb91bb0 2023-11-12 00:54:16,989 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/3a9de42a5eba46dfa5d475a7ccb91bb0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/3a9de42a5eba46dfa5d475a7ccb91bb0 2023-11-12 00:54:16,993 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/3a9de42a5eba46dfa5d475a7ccb91bb0, entries=1, sequenceid=21, filesize=4.9 K 2023-11-12 00:54:16,994 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 827ms, sequenceid=21, compaction requested=true 2023-11-12 00:54:16,994 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:16,994 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:16,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:16,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:16,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:16,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:16,996 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,996 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:16,996 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,996 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:16,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:16,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@298dad18[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:16,997 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:16,997 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,999 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:16,999 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:16,999 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:16,999 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:16,999 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:16,999 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:17,000 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:17,000 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,000 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:17,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:17,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:17,000 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:17,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:17,002 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:17,003 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:17,003 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:17,003 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,003 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:17,009 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,009 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:17,009 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:17,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:17,009 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,010 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:17,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:17,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,013 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:17,013 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:17,113 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:17,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:17,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:17,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:17,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,119 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:17,119 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:17,119 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:17,119 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:17,120 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,120 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,121 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,121 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:17,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:17,122 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,122 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:17,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,122 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,123 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:17,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:17,123 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:17,123 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:17,123 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:17,123 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:17,240 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:54:17,539 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f08c6003b3be42868f16be0ed4f5db85 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f08c6003b3be42868f16be0ed4f5db85 2023-11-12 00:54:17,945 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/8388ea9ecec24e1bb883cbd258437f80 2023-11-12 00:54:17,950 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/8388ea9ecec24e1bb883cbd258437f80 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/8388ea9ecec24e1bb883cbd258437f80 2023-11-12 00:54:17,954 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/8388ea9ecec24e1bb883cbd258437f80, entries=1, sequenceid=25, filesize=4.9 K 2023-11-12 00:54:17,955 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 832ms, sequenceid=25, compaction requested=true 2023-11-12 00:54:17,955 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:17,955 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:17,955 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:17,957 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:17,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:17,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:17,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:17,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66c6371[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:17,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:17,959 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,961 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,961 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:17,961 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:17,961 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:17,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,961 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:17,962 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:17,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:17,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:17,964 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:17,964 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:17,964 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:17,965 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,965 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:17,966 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,966 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:17,966 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:17,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:17,967 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:17,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,968 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,970 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:17,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-12 00:54:17,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:17,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:17,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:17,970 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,971 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,971 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:17,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:17,971 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:17,971 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:18,071 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:18,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:18,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:18,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:18,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,077 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:18,077 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:18,077 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:18,077 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:18,078 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,078 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,079 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:18,079 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:18,080 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,080 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:18,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,080 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:18,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:18,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:18,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:18,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:18,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:18,081 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:18,081 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:18,081 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:18,493 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f8df9db2e02f427c83698cb731991dfb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f8df9db2e02f427c83698cb731991dfb 2023-11-12 00:54:18,899 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/827c5af77e084db4b4973f6dc713027d 2023-11-12 00:54:18,903 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/827c5af77e084db4b4973f6dc713027d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/827c5af77e084db4b4973f6dc713027d 2023-11-12 00:54:18,907 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/827c5af77e084db4b4973f6dc713027d, entries=1, sequenceid=29, filesize=4.9 K 2023-11-12 00:54:18,908 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 827ms, sequenceid=29, compaction requested=true 2023-11-12 00:54:18,908 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:18,908 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:18,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:18,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:18,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:18,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:18,910 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,910 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:18,910 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,910 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:18,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:18,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:18,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:18,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d07fd9f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:18,911 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:18,911 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,912 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,913 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:18,913 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:18,913 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:18,913 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,913 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:18,914 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:18,914 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,914 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:18,914 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:18,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:18,916 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:18,916 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:18,916 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:18,916 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,916 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:18,919 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,919 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:18,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,919 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:18,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:18,920 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:18,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:18,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,921 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:18,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:18,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:18,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:18,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:18,923 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,923 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:18,924 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,924 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:18,924 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:18,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:18,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:18,924 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:19,024 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:19,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:19,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:19,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:19,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,030 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:19,030 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:19,030 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:19,030 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:19,030 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,031 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,032 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,032 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:19,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:19,032 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,032 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:19,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:19,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:19,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:19,034 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:19,034 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:19,034 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:19,034 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:19,034 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:19,446 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e9df962407304f15a60c49eb609005aa to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9df962407304f15a60c49eb609005aa 2023-11-12 00:54:19,851 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/1ef79306125d4c99b90907714186a092 2023-11-12 00:54:19,856 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/1ef79306125d4c99b90907714186a092 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1ef79306125d4c99b90907714186a092 2023-11-12 00:54:19,860 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1ef79306125d4c99b90907714186a092, entries=1, sequenceid=33, filesize=4.9 K 2023-11-12 00:54:19,861 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 827ms, sequenceid=33, compaction requested=true 2023-11-12 00:54:19,861 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:19,861 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:19,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:19,863 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,863 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:19,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:19,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@274a844[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:19,865 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:19,865 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,870 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:19,870 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:19,870 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,870 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:19,872 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:19,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:19,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:19,874 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:19,874 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:19,874 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:19,874 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,874 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:19,876 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,876 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:19,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,876 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:19,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:19,876 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:19,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,878 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:19,884 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:19,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:19,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:19,884 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:19,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:19,984 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:19,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:19,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:19,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:19,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,990 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:19,990 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:19,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:19,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:19,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,991 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,992 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,992 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:19,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:19,992 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:19,993 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:19,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:19,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:19,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:19,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:19,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:19,994 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:19,994 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:19,994 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:19,994 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:20,407 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c747b067d1ec47e5b0fe9879c668f688 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907c747b067d1ec47e5b0fe9879c668f688 2023-11-12 00:54:20,812 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/9de39f1bd0cb44fb96033021b5b1e86e 2023-11-12 00:54:20,817 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/9de39f1bd0cb44fb96033021b5b1e86e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/9de39f1bd0cb44fb96033021b5b1e86e 2023-11-12 00:54:20,822 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/9de39f1bd0cb44fb96033021b5b1e86e, entries=1, sequenceid=37, filesize=4.9 K 2023-11-12 00:54:20,822 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 828ms, sequenceid=37, compaction requested=true 2023-11-12 00:54:20,823 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:20,823 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:20,823 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:20,823 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:20,823 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,823 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:20,823 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:20,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,825 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:20,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,825 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:20,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:20,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:20,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4655307f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:20,826 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:20,826 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,828 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,828 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:20,828 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:20,828 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:20,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:20,830 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:20,830 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,830 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:20,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:20,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:20,830 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:20,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:20,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:20,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:20,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:20,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:20,832 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:20,832 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:20,832 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:20,832 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,832 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:20,834 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,834 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:20,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,834 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:20,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:20,834 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,836 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:20,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:20,838 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:20,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:20,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,839 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:20,839 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:20,839 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:20,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:20,939 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:20,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:20,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:20,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:20,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,945 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:20,945 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:20,945 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-12 00:54:20,945 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-12 00:54:20,945 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,945 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,947 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,947 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:20,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:20,947 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:20,947 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,948 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,948 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-12 00:54:20,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:20,948 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-12 00:54:20,948 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:20,948 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-12 00:54:20,948 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:20,948 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:20,948 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:20,948 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. started... 2023-11-12 00:54:20,948 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e54322db166e4083ab73da40eb699d45 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:21,361 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112084ad0d07329643c2aa98b0de85d800d6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112084ad0d07329643c2aa98b0de85d800d6 2023-11-12 00:54:21,766 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/71a737a98697441caef95aeb648b3d24 2023-11-12 00:54:21,771 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/71a737a98697441caef95aeb648b3d24 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/71a737a98697441caef95aeb648b3d24 2023-11-12 00:54:21,775 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/71a737a98697441caef95aeb648b3d24, entries=1, sequenceid=41, filesize=4.9 K 2023-11-12 00:54:21,775 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e54322db166e4083ab73da40eb699d45 in 827ms, sequenceid=41, compaction requested=true 2023-11-12 00:54:21,775 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:21,775 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-12 00:54:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-12 00:54:21,779 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,779 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:21,779 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,779 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:21,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:21,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-12 00:54:21,781 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-12 00:54:21,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2347a42f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:21,781 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,782 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-12 00:54:21,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-12 00:54:21,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:21,782 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,782 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:21,783 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-12 00:54:21,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:21,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:21,783 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-12 00:54:21,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:21,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:21,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:21,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:21,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:54:21,786 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-12 00:54:21,786 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:21,786 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:21,786 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,786 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:21,788 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,788 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:21,788 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:21,788 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:21,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,789 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:21,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:21,798 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:21,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-12 00:54:21,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:21,798 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:21,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:21,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:21,898 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:21,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:21,900 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-12 00:54:21,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:54:21,902 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:54:21,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:21,903 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751061903 2023-11-12 00:54:21,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:21,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-12 00:54:21,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:21,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x30979cd3 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:21,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1368aa59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:21,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,383 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.5384615384615384, tune throughput to 76.92 MB/second 2023-11-12 00:54:22,756 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037873f56ba129428897e430028b3d16e3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601037873f56ba129428897e430028b3d16e3 2023-11-12 00:54:22,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:22,770 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:22,771 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:22,777 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:22,778 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:22,786 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30bcbfb174044f299792666ca7774ffe first=Optional[r3] last=Optional[r6] 2023-11-12 00:54:22,787 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30bcbfb174044f299792666ca7774ffe}] 2023-11-12 00:54:22,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30bcbfb174044f299792666ca7774ffe for inclusion in e54322db166e4083ab73da40eb699d45/family1 2023-11-12 00:54:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-12 00:54:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:22,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/30bcbfb174044f299792666ca7774ffe to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f5fkq59rv74b9klhc7n6g8f3q1mt9ui2l9qbsfilari50tb86lto7l9ai2bicrgg/family1/30bcbfb174044f299792666ca7774ffe 2023-11-12 00:54:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f5fkq59rv74b9klhc7n6g8f3q1mt9ui2l9qbsfilari50tb86lto7l9ai2bicrgg/family1/30bcbfb174044f299792666ca7774ffe as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_ 2023-11-12 00:54:22,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f5fkq59rv74b9klhc7n6g8f3q1mt9ui2l9qbsfilari50tb86lto7l9ai2bicrgg/family1/30bcbfb174044f299792666ca7774ffe into e54322db166e4083ab73da40eb699d45/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_ - updating store file list. 2023-11-12 00:54:22,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_ into e54322db166e4083ab73da40eb699d45/family1 2023-11-12 00:54:22,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f5fkq59rv74b9klhc7n6g8f3q1mt9ui2l9qbsfilari50tb86lto7l9ai2bicrgg/family1/30bcbfb174044f299792666ca7774ffe into e54322db166e4083ab73da40eb699d45/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_) 2023-11-12 00:54:22,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f5fkq59rv74b9klhc7n6g8f3q1mt9ui2l9qbsfilari50tb86lto7l9ai2bicrgg/family1/30bcbfb174044f299792666ca7774ffe 2023-11-12 00:54:22,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:54:22,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:54:22,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): e54322db166e4083ab73da40eb699d45/family1 is initiating minor compaction 2023-11-12 00:54:22,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@343a7c03; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:22,803 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e54322db166e4083ab73da40eb699d45/family1 in testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:22,803 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/14a736f8e16444ec99e3c773a1122350, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/f2af76d8dd9a4cc99f6350604afe0de9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1d254343ba87436e8718be7951cbe3d4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/3a9de42a5eba46dfa5d475a7ccb91bb0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/8388ea9ecec24e1bb883cbd258437f80, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/827c5af77e084db4b4973f6dc713027d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1ef79306125d4c99b90907714186a092, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/9de39f1bd0cb44fb96033021b5b1e86e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/71a737a98697441caef95aeb648b3d24, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp, totalSize=50.0 K 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 14a736f8e16444ec99e3c773a1122350, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting f2af76d8dd9a4cc99f6350604afe0de9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 1d254343ba87436e8718be7951cbe3d4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 3a9de42a5eba46dfa5d475a7ccb91bb0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 8388ea9ecec24e1bb883cbd258437f80, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 827c5af77e084db4b4973f6dc713027d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:54:22,803 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 1ef79306125d4c99b90907714186a092, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:54:22,804 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 9de39f1bd0cb44fb96033021b5b1e86e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:54:22,804 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 71a737a98697441caef95aeb648b3d24, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:54:22,804 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 662c10e9de684a4ca7210f070e4c3635_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:54:22,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:22,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:22,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512287f7957a6562449369d5d3783063d092d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512287f7957a6562449369d5d3783063d092d 2023-11-12 00:54:22,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f08c6003b3be42868f16be0ed4f5db85 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f08c6003b3be42868f16be0ed4f5db85 2023-11-12 00:54:22,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f8df9db2e02f427c83698cb731991dfb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f8df9db2e02f427c83698cb731991dfb 2023-11-12 00:54:22,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9df962407304f15a60c49eb609005aa to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e9df962407304f15a60c49eb609005aa 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-12 00:54:22,812 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:22,842 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): e54322db166e4083ab73da40eb699d45#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:23,658 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/1947e54e692249e18d3391f4867d619f as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1947e54e692249e18d3391f4867d619f 2023-11-12 00:54:23,664 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e54322db166e4083ab73da40eb699d45/family1 of e54322db166e4083ab73da40eb699d45 into 1947e54e692249e18d3391f4867d619f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:54:23,664 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:23,664 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699750462803; duration=0sec 2023-11-12 00:54:23,664 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:23,666 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b3df11c8366441c4a39761be6fcd7fff to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b3df11c8366441c4a39761be6fcd7fff 2023-11-12 00:54:23,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:23,696 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed7ce18be69349c1bf2de10dd3445838 first=Optional[r00] last=Optional[r2] 2023-11-12 00:54:23,696 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed7ce18be69349c1bf2de10dd3445838}] 2023-11-12 00:54:23,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed7ce18be69349c1bf2de10dd3445838 for inclusion in e54322db166e4083ab73da40eb699d45/family1 2023-11-12 00:54:23,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-12 00:54:23,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:23,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:23,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ed7ce18be69349c1bf2de10dd3445838 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4b41076nu3liqa2hc68sadp1t5q4vh6eon6ca1g790mcn2mnijg8d8tregsd9v10/family1/ed7ce18be69349c1bf2de10dd3445838 2023-11-12 00:54:23,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4b41076nu3liqa2hc68sadp1t5q4vh6eon6ca1g790mcn2mnijg8d8tregsd9v10/family1/ed7ce18be69349c1bf2de10dd3445838 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_ 2023-11-12 00:54:23,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4b41076nu3liqa2hc68sadp1t5q4vh6eon6ca1g790mcn2mnijg8d8tregsd9v10/family1/ed7ce18be69349c1bf2de10dd3445838 into e54322db166e4083ab73da40eb699d45/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_ - updating store file list. 2023-11-12 00:54:23,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_ into e54322db166e4083ab73da40eb699d45/family1 2023-11-12 00:54:23,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4b41076nu3liqa2hc68sadp1t5q4vh6eon6ca1g790mcn2mnijg8d8tregsd9v10/family1/ed7ce18be69349c1bf2de10dd3445838 into e54322db166e4083ab73da40eb699d45/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_) 2023-11-12 00:54:23,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4b41076nu3liqa2hc68sadp1t5q4vh6eon6ca1g790mcn2mnijg8d8tregsd9v10/family1/ed7ce18be69349c1bf2de10dd3445838 2023-11-12 00:54:23,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:54:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:54:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): e54322db166e4083ab73da40eb699d45/family1 is initiating minor compaction (all files) 2023-11-12 00:54:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@66513e50; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:23,710 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of e54322db166e4083ab73da40eb699d45/family1 in testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:54:23,711 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/d5cac70bc01740ca88b15bf9dfd3e9ff, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1947e54e692249e18d3391f4867d619f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp, totalSize=337.0 K 2023-11-12 00:54:23,711 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting d5cac70bc01740ca88b15bf9dfd3e9ff, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:54:23,711 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 1947e54e692249e18d3391f4867d619f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:54:23,712 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting b95d0182735e49219fa5610f69b6a1bd_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823723 2023-11-12 00:54:23,712 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:23,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:23,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307c19d2917cd344c2b9f11f70b9ef5750 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511307c19d2917cd344c2b9f11f70b9ef5750 2023-11-12 00:54:23,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512012ded9d4004124a6191b1dcdd8ffdc610 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512012ded9d4004124a6191b1dcdd8ffdc610 2023-11-12 00:54:23,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051fa5926506a641e5a95d41a9258a1247 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051fa5926506a641e5a95d41a9258a1247 2023-11-12 00:54:23,717 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-12 00:54:23,717 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-12 00:54:23,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-12 00:54:23,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-12 00:54:23,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:23,719 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:54:23,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8180 sec 2023-11-12 00:54:23,728 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): e54322db166e4083ab73da40eb699d45#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:23,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/14a736f8e16444ec99e3c773a1122350, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/f2af76d8dd9a4cc99f6350604afe0de9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1d254343ba87436e8718be7951cbe3d4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/3a9de42a5eba46dfa5d475a7ccb91bb0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/8388ea9ecec24e1bb883cbd258437f80, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/827c5af77e084db4b4973f6dc713027d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1ef79306125d4c99b90907714186a092, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/9de39f1bd0cb44fb96033021b5b1e86e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/71a737a98697441caef95aeb648b3d24, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_] to archive 2023-11-12 00:54:23,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:23,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/14a736f8e16444ec99e3c773a1122350 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/14a736f8e16444ec99e3c773a1122350 2023-11-12 00:54:23,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/f2af76d8dd9a4cc99f6350604afe0de9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/f2af76d8dd9a4cc99f6350604afe0de9 2023-11-12 00:54:23,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1d254343ba87436e8718be7951cbe3d4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1d254343ba87436e8718be7951cbe3d4 2023-11-12 00:54:23,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/3a9de42a5eba46dfa5d475a7ccb91bb0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/3a9de42a5eba46dfa5d475a7ccb91bb0 2023-11-12 00:54:23,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/8388ea9ecec24e1bb883cbd258437f80 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/8388ea9ecec24e1bb883cbd258437f80 2023-11-12 00:54:23,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/827c5af77e084db4b4973f6dc713027d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/827c5af77e084db4b4973f6dc713027d 2023-11-12 00:54:23,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1ef79306125d4c99b90907714186a092 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1ef79306125d4c99b90907714186a092 2023-11-12 00:54:23,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/9de39f1bd0cb44fb96033021b5b1e86e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/9de39f1bd0cb44fb96033021b5b1e86e 2023-11-12 00:54:23,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/71a737a98697441caef95aeb648b3d24 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/71a737a98697441caef95aeb648b3d24 2023-11-12 00:54:23,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/662c10e9de684a4ca7210f070e4c3635_SeqId_44_ 2023-11-12 00:54:23,811 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258 (was 252) - Thread LEAK? -, OpenFileDescriptor=647 (was 621) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=191 (was 227), ProcessCount=171 (was 171), AvailableMemoryMB=927 (was 933) 2023-11-12 00:54:23,823 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=258, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=171, AvailableMemoryMB=927 2023-11-12 00:54:23,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-12 00:54:23,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:23,827 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:54:23,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-12 00:54:23,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:54:23,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-12 00:54:23,829 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:23,829 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 empty. 2023-11-12 00:54:23,830 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:23,830 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-12 00:54:23,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-12 00:54:24,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-12 00:54:24,238 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:24,239 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => d365b140a0de7324ebb5ec50ebb65fe1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:24,244 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:24,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing d365b140a0de7324ebb5ec50ebb65fe1, disabling compactions & flushes 2023-11-12 00:54:24,245 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. after waiting 0 ms 2023-11-12 00:54:24,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,245 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,245 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:24,247 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:54:24,248 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750464248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750464248"}]},"ts":"1699750464248"} 2023-11-12 00:54:24,250 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:54:24,250 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:54:24,251 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750464250"}]},"ts":"1699750464250"} 2023-11-12 00:54:24,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-12 00:54:24,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, ASSIGN}] 2023-11-12 00:54:24,257 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, ASSIGN 2023-11-12 00:54:24,258 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:24,409 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:24,409 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750464409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750464409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750464409"}]},"ts":"1699750464409"} 2023-11-12 00:54:24,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:24,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-12 00:54:24,562 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:24,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d365b140a0de7324ebb5ec50ebb65fe1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:24,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:24,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,566 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,568 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:24,568 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:24,569 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d365b140a0de7324ebb5ec50ebb65fe1 columnFamilyName family1 2023-11-12 00:54:24,570 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(310): Store=d365b140a0de7324ebb5ec50ebb65fe1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:24,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:24,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:24,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d365b140a0de7324ebb5ec50ebb65fe1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60258952, jitterRate=-0.10207164287567139}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:24,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:24,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., pid=41, masterSystemTime=1699750464562 2023-11-12 00:54:24,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:24,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750464578"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750464578"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750464578"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750464578"}]},"ts":"1699750464578"} 2023-11-12 00:54:24,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-12 00:54:24,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629 in 168 msec 2023-11-12 00:54:24,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-12 00:54:24,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, ASSIGN in 324 msec 2023-11-12 00:54:24,582 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:54:24,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750464582"}]},"ts":"1699750464582"} 2023-11-12 00:54:24,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-12 00:54:24,585 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:54:24,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 761 msec 2023-11-12 00:54:24,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-12 00:54:24,931 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-12 00:54:24,946 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/.tmp/family1/daff796f29894e7d909cc5e2b3d89250 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/daff796f29894e7d909cc5e2b3d89250 2023-11-12 00:54:24,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:24,952 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e54322db166e4083ab73da40eb699d45/family1 of e54322db166e4083ab73da40eb699d45 into daff796f29894e7d909cc5e2b3d89250(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:54:24,952 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:54:24,952 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1699750463710; duration=1sec 2023-11-12 00:54:24,952 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:24,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,954 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:24,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:24,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:24,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:24,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,956 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:24,956 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:24,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:24,956 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:24,956 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:24,958 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:24,958 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:24,958 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:24,958 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:24,958 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:24,958 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:24,958 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:24,959 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:54:24,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/d5cac70bc01740ca88b15bf9dfd3e9ff, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1947e54e692249e18d3391f4867d619f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_] to archive 2023-11-12 00:54:24,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:24,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/d5cac70bc01740ca88b15bf9dfd3e9ff to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/d5cac70bc01740ca88b15bf9dfd3e9ff 2023-11-12 00:54:24,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1947e54e692249e18d3391f4867d619f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/1947e54e692249e18d3391f4867d619f 2023-11-12 00:54:24,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/family1/b95d0182735e49219fa5610f69b6a1bd_SeqId_47_ 2023-11-12 00:54:25,377 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ba9b15ded72643df9c57c86eba92b990 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba9b15ded72643df9c57c86eba92b990 2023-11-12 00:54:25,781 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/7e36744f390b4df2854db18fa739b740 2023-11-12 00:54:25,786 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/7e36744f390b4df2854db18fa739b740 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7e36744f390b4df2854db18fa739b740 2023-11-12 00:54:25,790 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7e36744f390b4df2854db18fa739b740, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-12 00:54:25,791 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 832ms, sequenceid=5, compaction requested=false 2023-11-12 00:54:25,791 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:25,791 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:25,791 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:25,791 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:25,792 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:25,793 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,793 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:25,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:25,793 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,794 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:25,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:25,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41ce4edd[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:25,795 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:25,795 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,798 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:25,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:25,798 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:25,798 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,798 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:25,799 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,799 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,799 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:25,799 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:25,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:25,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:25,802 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:25,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:25,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:25,802 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,802 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:25,803 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,803 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:25,803 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:25,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:25,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:25,804 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,805 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,807 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,807 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,807 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:25,807 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,807 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:25,807 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:25,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:25,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:25,807 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:25,808 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:25,808 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,808 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,808 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:25,808 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:25,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:25,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:25,908 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:25,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:25,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:25,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:25,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,914 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:25,914 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:25,914 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:25,914 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:25,915 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,915 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,916 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:25,916 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:25,917 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:25,917 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,917 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,918 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,918 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:25,918 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:25,918 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:25,918 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:25,918 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:54:26,331 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128413b45dac64f492e8b067df376aba3c6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128413b45dac64f492e8b067df376aba3c6 2023-11-12 00:54:26,737 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/088594010029484aa426bde9f52e5b9d 2023-11-12 00:54:26,742 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/088594010029484aa426bde9f52e5b9d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/088594010029484aa426bde9f52e5b9d 2023-11-12 00:54:26,747 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/088594010029484aa426bde9f52e5b9d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:54:26,747 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 829ms, sequenceid=9, compaction requested=false 2023-11-12 00:54:26,747 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:26,748 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:26,748 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:26,749 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,749 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:26,750 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,750 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:26,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:26,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66dff828[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:26,751 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:26,752 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,753 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:26,753 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:26,753 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,753 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:26,755 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:26,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:26,758 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:26,758 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:26,758 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:26,758 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,758 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:26,760 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,760 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:26,760 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:26,760 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:26,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,767 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:26,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:26,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:26,767 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,768 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,768 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,768 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:26,768 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:26,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:26,868 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:26,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:26,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:26,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:26,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,875 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:26,875 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:26,875 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:26,875 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:26,875 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,875 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,877 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,877 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:26,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:26,877 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:26,877 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,878 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,878 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:26,879 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:26,879 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:26,879 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:27,291 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012647c5458ed042788815bed3462c14c8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512012647c5458ed042788815bed3462c14c8 2023-11-12 00:54:27,696 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/054c9244f0bc4d5fb2dc396bff6bd27e 2023-11-12 00:54:27,701 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/054c9244f0bc4d5fb2dc396bff6bd27e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/054c9244f0bc4d5fb2dc396bff6bd27e 2023-11-12 00:54:27,705 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/054c9244f0bc4d5fb2dc396bff6bd27e, entries=1, sequenceid=13, filesize=5.0 K 2023-11-12 00:54:27,705 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 826ms, sequenceid=13, compaction requested=true 2023-11-12 00:54:27,706 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:27,706 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:27,706 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:27,706 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:27,706 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,706 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:27,706 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:27,708 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,708 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:27,708 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,708 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:27,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9e6ea44[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:27,709 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:27,710 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,711 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,712 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:27,712 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:27,712 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:27,712 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,712 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:27,713 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:27,713 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:27,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,713 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:27,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:27,715 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:27,715 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:27,715 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:27,715 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,715 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:27,717 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,717 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,717 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:27,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:27,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:27,717 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:27,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,719 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:27,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,721 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:27,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:27,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:27,721 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,722 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,722 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:27,722 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:27,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:27,822 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:27,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:27,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:27,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:27,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,828 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:27,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:27,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:27,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:27,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,828 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,831 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:27,831 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:27,831 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:27,831 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:27,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:27,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:27,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:27,833 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:27,833 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:27,833 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:27,833 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:27,833 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:28,244 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120574b66799e9c0438bb6b9040ec488b7bb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120574b66799e9c0438bb6b9040ec488b7bb 2023-11-12 00:54:28,250 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/b8e76bb6cf21459db6e31deeb13e435f 2023-11-12 00:54:28,254 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/b8e76bb6cf21459db6e31deeb13e435f as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/b8e76bb6cf21459db6e31deeb13e435f 2023-11-12 00:54:28,258 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/b8e76bb6cf21459db6e31deeb13e435f, entries=1, sequenceid=17, filesize=5.0 K 2023-11-12 00:54:28,259 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 426ms, sequenceid=17, compaction requested=true 2023-11-12 00:54:28,259 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:28,259 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:28,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:28,261 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,261 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:28,262 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,262 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:28,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:28,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@179e418b[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:28,263 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:28,263 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,264 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:28,265 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,265 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:28,266 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:28,266 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:28,266 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,266 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:28,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:28,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:28,268 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:28,268 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:28,269 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:28,269 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,269 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:28,271 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,271 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:28,271 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:28,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:28,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:28,272 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:28,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,273 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:28,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:28,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,276 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:28,276 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:28,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:28,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:28,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:28,276 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:28,276 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:28,276 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:28,276 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,376 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:28,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:28,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:28,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:28,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,382 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:28,382 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:28,382 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:28,382 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:28,383 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,383 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,385 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:28,385 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:28,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:28,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,385 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:28,385 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:28,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:28,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:28,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:28,386 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:28,386 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:28,387 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:28,801 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122854aa2a6cc9584106af1f10ff884441df to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122854aa2a6cc9584106af1f10ff884441df 2023-11-12 00:54:29,206 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/4118b46cc4ef43aeb9e279fbff720a99 2023-11-12 00:54:29,211 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/4118b46cc4ef43aeb9e279fbff720a99 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4118b46cc4ef43aeb9e279fbff720a99 2023-11-12 00:54:29,215 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4118b46cc4ef43aeb9e279fbff720a99, entries=1, sequenceid=21, filesize=5.0 K 2023-11-12 00:54:29,216 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 829ms, sequenceid=21, compaction requested=true 2023-11-12 00:54:29,216 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:29,216 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:29,222 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,222 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:29,222 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,222 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:29,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24154d03[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:29,223 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:29,223 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,225 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,225 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:29,225 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:29,225 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:29,225 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,225 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:29,227 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:29,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,228 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:29,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:29,230 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:29,230 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:29,230 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:29,230 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,230 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:29,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:29,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:29,232 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:29,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:29,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,234 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:29,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:29,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:29,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:29,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-12 00:54:29,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:29,237 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:29,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:29,238 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:29,237 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,338 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:29,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:29,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:29,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:29,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,344 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:29,344 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:29,344 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:29,344 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:29,344 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,344 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,346 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:29,346 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:29,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:29,346 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:29,346 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:29,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,347 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:29,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:29,347 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:29,347 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:29,348 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:29,760 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c033eae5b74c4f01b3b5ad98843db7a3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231c033eae5b74c4f01b3b5ad98843db7a3 2023-11-12 00:54:30,100 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:54:30,166 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/f14f82389b694c41b52e980d5239428c 2023-11-12 00:54:30,171 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/f14f82389b694c41b52e980d5239428c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/f14f82389b694c41b52e980d5239428c 2023-11-12 00:54:30,174 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/f14f82389b694c41b52e980d5239428c, entries=1, sequenceid=25, filesize=5.0 K 2023-11-12 00:54:30,175 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 827ms, sequenceid=25, compaction requested=true 2023-11-12 00:54:30,175 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:30,175 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:30,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:30,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:30,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:30,175 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:30,177 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,177 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:30,177 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,177 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:30,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d92ff11[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:30,178 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:30,178 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,179 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,180 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:30,180 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:30,180 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:30,180 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,180 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:30,181 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,181 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:30,181 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:30,181 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:30,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:30,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:30,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:30,183 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:30,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:30,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:30,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,183 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:30,186 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,186 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:30,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,186 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:30,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:30,186 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,187 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:30,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,190 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:30,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:30,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:30,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:30,190 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:30,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:30,291 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:30,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:30,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:30,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:30,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,297 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:30,297 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:30,297 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:30,297 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:30,297 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,297 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,298 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,299 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:30,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:30,299 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:30,299 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,300 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,300 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:30,300 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:30,300 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:30,300 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:30,300 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:30,712 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101001d77a86d5b471f9ec42cfc61653747 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101001d77a86d5b471f9ec42cfc61653747 2023-11-12 00:54:31,117 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/7b86c6718c8f453ab7cf9599aa7ba0c0 2023-11-12 00:54:31,122 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/7b86c6718c8f453ab7cf9599aa7ba0c0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7b86c6718c8f453ab7cf9599aa7ba0c0 2023-11-12 00:54:31,126 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7b86c6718c8f453ab7cf9599aa7ba0c0, entries=1, sequenceid=29, filesize=5.0 K 2023-11-12 00:54:31,126 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 826ms, sequenceid=29, compaction requested=true 2023-11-12 00:54:31,126 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:31,126 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:31,126 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:31,126 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:31,126 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,126 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:31,127 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:31,128 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,128 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:31,129 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,129 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:31,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:31,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@398862d[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:31,130 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:31,130 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,132 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,132 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:31,132 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:31,132 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:31,132 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,132 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:31,136 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:31,136 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,136 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:31,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:31,136 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:31,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:31,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:31,139 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:31,139 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:31,139 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:31,139 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,139 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:31,140 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:31,140 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,141 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:31,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:31,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:31,141 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:31,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,142 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:31,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,146 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:31,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:31,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:31,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:31,146 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:31,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:31,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:31,246 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:31,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:31,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:31,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:31,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,253 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:31,253 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:31,253 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:31,254 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:31,254 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,254 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,255 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:31,255 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:31,255 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:31,256 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:31,257 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:31,257 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:31,257 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:31,668 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010370529ece337a45289d5b3434f06cfbf0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010370529ece337a45289d5b3434f06cfbf0 2023-11-12 00:54:32,074 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/8e1528be041c407e941ec664fac5a93d 2023-11-12 00:54:32,079 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/8e1528be041c407e941ec664fac5a93d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/8e1528be041c407e941ec664fac5a93d 2023-11-12 00:54:32,083 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/8e1528be041c407e941ec664fac5a93d, entries=1, sequenceid=33, filesize=5.0 K 2023-11-12 00:54:32,084 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 827ms, sequenceid=33, compaction requested=true 2023-11-12 00:54:32,084 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:32,084 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:32,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:32,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:32,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@666f1dcc[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:32,088 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:32,088 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,089 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:32,090 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:32,090 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,090 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:32,092 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:32,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:32,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:32,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:32,094 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:32,094 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:32,094 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:32,094 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,094 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:32,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:32,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:32,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:32,097 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,098 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:32,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,101 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-12 00:54:32,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:32,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:32,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:32,101 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:32,102 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:32,202 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:32,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:32,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:32,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,207 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:32,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:32,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:32,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:32,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,209 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,209 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:32,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:32,210 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:32,210 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:32,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:32,211 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:32,211 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:32,211 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:32,211 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:32,211 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:32,211 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:32,211 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:32,211 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:32,639 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:32,639 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30979cd3 to 127.0.0.1:60532 2023-11-12 00:54:32,639 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:32,639 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:32,640 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x401dc135 to 127.0.0.1:60532 2023-11-12 00:54:32,640 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:32,640 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:32,640 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x373c3084 to 127.0.0.1:60532 2023-11-12 00:54:32,640 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:32,641 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907014421de342d4bcab6864547dbb871a6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907014421de342d4bcab6864547dbb871a6 2023-11-12 00:54:33,047 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/24fbb907274742dba90ac0d2bea81cf4 2023-11-12 00:54:33,051 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/24fbb907274742dba90ac0d2bea81cf4 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/24fbb907274742dba90ac0d2bea81cf4 2023-11-12 00:54:33,055 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/24fbb907274742dba90ac0d2bea81cf4, entries=1, sequenceid=37, filesize=5.0 K 2023-11-12 00:54:33,056 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 845ms, sequenceid=37, compaction requested=true 2023-11-12 00:54:33,056 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:33,056 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:33,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:33,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:33,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:33,056 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:33,058 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,058 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:33,058 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,058 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:33,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:33,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681c2957[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:33,060 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:33,060 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,061 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:33,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:33,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:33,062 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,062 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:33,064 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:33,064 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:33,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:33,067 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:33,067 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:33,067 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:33,067 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,067 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:33,071 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,071 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,072 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:33,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:33,072 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:33,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:33,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,073 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:33,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:33,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-12 00:54:33,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:33,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:33,076 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:33,077 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:33,077 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:33,177 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:33,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:33,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:33,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:33,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,183 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:33,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:33,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-12 00:54:33,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-12 00:54:33,184 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,184 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,186 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:33,186 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:33,186 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:33,186 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,187 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,187 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-12 00:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:33,187 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-12 00:54:33,188 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:33,188 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-12 00:54:33,188 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:33,188 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:33,188 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:33,188 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. started... 2023-11-12 00:54:33,188 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d365b140a0de7324ebb5ec50ebb65fe1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:33,600 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fa5e1b624e4c41b29b0e9c8d3075ef16 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fa5e1b624e4c41b29b0e9c8d3075ef16 2023-11-12 00:54:34,005 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/4b7e8c4ebb244553bef78528fc1e7eb6 2023-11-12 00:54:34,010 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/4b7e8c4ebb244553bef78528fc1e7eb6 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4b7e8c4ebb244553bef78528fc1e7eb6 2023-11-12 00:54:34,013 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4b7e8c4ebb244553bef78528fc1e7eb6, entries=1, sequenceid=41, filesize=5.0 K 2023-11-12 00:54:34,014 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d365b140a0de7324ebb5ec50ebb65fe1 in 826ms, sequenceid=41, compaction requested=true 2023-11-12 00:54:34,014 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:34,014 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:34,014 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:34,014 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:34,014 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,014 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-12 00:54:34,014 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-12 00:54:34,016 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,016 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:34,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:34,016 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,016 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:34,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:34,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:34,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:34,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-12 00:54:34,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42dc2932[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:34,018 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-12 00:54:34,018 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,019 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-12 00:54:34,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-12 00:54:34,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:34,019 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,019 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:34,020 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-12 00:54:34,020 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,020 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:34,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:34,021 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-12 00:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:34,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-12 00:54:34,023 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-12 00:54:34,023 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:34,023 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:34,023 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,023 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:34,026 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,026 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:34,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,026 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:34,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:34,026 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,028 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:34,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-12 00:54:34,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:34,030 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:34,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:34,031 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:34,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,031 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,031 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:34,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:34,131 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:34,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:34,133 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:34,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:34,135 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:34,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:34,135 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751074135 2023-11-12 00:54:34,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:34,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-12 00:54:34,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:34,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x3fdc7b96 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:34,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69b03456, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:34,143 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:34,976 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b8a880190f074dbd9518a054b45cf218 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103b8a880190f074dbd9518a054b45cf218 2023-11-12 00:54:34,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:34,990 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:34,991 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:34,997 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:34,999 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:35,007 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4e22a1b116f443809f644465e2763866 first=Optional[r3] last=Optional[r6] 2023-11-12 00:54:35,008 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4e22a1b116f443809f644465e2763866}] 2023-11-12 00:54:35,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4e22a1b116f443809f644465e2763866 for inclusion in d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:35,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-12 00:54:35,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:35,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:35,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4e22a1b116f443809f644465e2763866 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bitnd657vdavvdjbs29hqi6v4onatsdna9mjionvk8ohf9matg50ktt9c63eci6i/family1/4e22a1b116f443809f644465e2763866 2023-11-12 00:54:35,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bitnd657vdavvdjbs29hqi6v4onatsdna9mjionvk8ohf9matg50ktt9c63eci6i/family1/4e22a1b116f443809f644465e2763866 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_ 2023-11-12 00:54:35,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bitnd657vdavvdjbs29hqi6v4onatsdna9mjionvk8ohf9matg50ktt9c63eci6i/family1/4e22a1b116f443809f644465e2763866 into d365b140a0de7324ebb5ec50ebb65fe1/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_ - updating store file list. 2023-11-12 00:54:35,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_ into d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:35,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bitnd657vdavvdjbs29hqi6v4onatsdna9mjionvk8ohf9matg50ktt9c63eci6i/family1/4e22a1b116f443809f644465e2763866 into d365b140a0de7324ebb5ec50ebb65fe1/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_) 2023-11-12 00:54:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bitnd657vdavvdjbs29hqi6v4onatsdna9mjionvk8ohf9matg50ktt9c63eci6i/family1/4e22a1b116f443809f644465e2763866 2023-11-12 00:54:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:54:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:54:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): d365b140a0de7324ebb5ec50ebb65fe1/family1 is initiating minor compaction 2023-11-12 00:54:35,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b52292b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:35,025 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d365b140a0de7324ebb5ec50ebb65fe1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:35,025 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/088594010029484aa426bde9f52e5b9d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/054c9244f0bc4d5fb2dc396bff6bd27e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/b8e76bb6cf21459db6e31deeb13e435f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4118b46cc4ef43aeb9e279fbff720a99, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/f14f82389b694c41b52e980d5239428c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7b86c6718c8f453ab7cf9599aa7ba0c0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/8e1528be041c407e941ec664fac5a93d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/24fbb907274742dba90ac0d2bea81cf4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4b7e8c4ebb244553bef78528fc1e7eb6, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp, totalSize=50.4 K 2023-11-12 00:54:35,025 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 088594010029484aa426bde9f52e5b9d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:54:35,025 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 054c9244f0bc4d5fb2dc396bff6bd27e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:54:35,025 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting b8e76bb6cf21459db6e31deeb13e435f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:54:35,025 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 4118b46cc4ef43aeb9e279fbff720a99, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:54:35,025 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting f14f82389b694c41b52e980d5239428c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:54:35,025 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 7b86c6718c8f453ab7cf9599aa7ba0c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:54:35,026 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 8e1528be041c407e941ec664fac5a93d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:54:35,026 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 24fbb907274742dba90ac0d2bea81cf4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:54:35,026 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 4b7e8c4ebb244553bef78528fc1e7eb6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:54:35,026 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:54:35,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:35,027 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:35,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122854aa2a6cc9584106af1f10ff884441df to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122854aa2a6cc9584106af1f10ff884441df 2023-11-12 00:54:35,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231c033eae5b74c4f01b3b5ad98843db7a3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231c033eae5b74c4f01b3b5ad98843db7a3 2023-11-12 00:54:35,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101001d77a86d5b471f9ec42cfc61653747 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101001d77a86d5b471f9ec42cfc61653747 2023-11-12 00:54:35,033 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010370529ece337a45289d5b3434f06cfbf0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010370529ece337a45289d5b3434f06cfbf0 2023-11-12 00:54:35,033 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-12 00:54:35,033 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-12 00:54:35,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,059 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): d365b140a0de7324ebb5ec50ebb65fe1#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:35,875 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/7a3a3ba74c6c46e9a460c1a5e4b0bd03 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7a3a3ba74c6c46e9a460c1a5e4b0bd03 2023-11-12 00:54:35,880 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d365b140a0de7324ebb5ec50ebb65fe1/family1 of d365b140a0de7324ebb5ec50ebb65fe1 into 7a3a3ba74c6c46e9a460c1a5e4b0bd03(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:54:35,880 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:35,880 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699750475025; duration=0sec 2023-11-12 00:54:35,880 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:35,886 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120504c76acad21a445fbb8ecb2f9da774c9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120504c76acad21a445fbb8ecb2f9da774c9 2023-11-12 00:54:35,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:35,909 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a70831d7594d4c9771eba9de2224eb first=Optional[r00] last=Optional[r2] 2023-11-12 00:54:35,910 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a70831d7594d4c9771eba9de2224eb}] 2023-11-12 00:54:35,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a70831d7594d4c9771eba9de2224eb for inclusion in d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:35,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-12 00:54:35,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:35,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:35,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/47a70831d7594d4c9771eba9de2224eb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1gb4o1usvhhtvnq167inkn5ee297hjgta9e0k50b273v12sj33ee21bns20ip3re/family1/47a70831d7594d4c9771eba9de2224eb 2023-11-12 00:54:35,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1gb4o1usvhhtvnq167inkn5ee297hjgta9e0k50b273v12sj33ee21bns20ip3re/family1/47a70831d7594d4c9771eba9de2224eb as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_ 2023-11-12 00:54:35,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1gb4o1usvhhtvnq167inkn5ee297hjgta9e0k50b273v12sj33ee21bns20ip3re/family1/47a70831d7594d4c9771eba9de2224eb into d365b140a0de7324ebb5ec50ebb65fe1/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_ - updating store file list. 2023-11-12 00:54:35,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_ into d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:35,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1gb4o1usvhhtvnq167inkn5ee297hjgta9e0k50b273v12sj33ee21bns20ip3re/family1/47a70831d7594d4c9771eba9de2224eb into d365b140a0de7324ebb5ec50ebb65fe1/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_) 2023-11-12 00:54:35,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__1gb4o1usvhhtvnq167inkn5ee297hjgta9e0k50b273v12sj33ee21bns20ip3re/family1/47a70831d7594d4c9771eba9de2224eb 2023-11-12 00:54:35,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:54:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:54:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): d365b140a0de7324ebb5ec50ebb65fe1/family1 is initiating minor compaction (all files) 2023-11-12 00:54:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4a8a98cd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:35,922 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d365b140a0de7324ebb5ec50ebb65fe1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:35,922 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7e36744f390b4df2854db18fa739b740, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7a3a3ba74c6c46e9a460c1a5e4b0bd03, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp, totalSize=390.1 K 2023-11-12 00:54:35,922 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 7e36744f390b4df2854db18fa739b740, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:54:35,923 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 7a3a3ba74c6c46e9a460c1a5e4b0bd03, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:54:35,923 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting d0949472f00c4a28adad8630c8395067_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823723 2023-11-12 00:54:35,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:35,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:35,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba9b15ded72643df9c57c86eba92b990 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130ba9b15ded72643df9c57c86eba92b990 2023-11-12 00:54:35,927 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512012647c5458ed042788815bed3462c14c8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512012647c5458ed042788815bed3462c14c8 2023-11-12 00:54:35,928 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120574b66799e9c0438bb6b9040ec488b7bb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120574b66799e9c0438bb6b9040ec488b7bb 2023-11-12 00:54:35,928 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-12 00:54:35,928 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-12 00:54:35,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:35,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:35,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:35,929 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:35,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.7960 sec 2023-11-12 00:54:35,942 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): d365b140a0de7324ebb5ec50ebb65fe1#family1#compaction#62 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:35,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/088594010029484aa426bde9f52e5b9d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/054c9244f0bc4d5fb2dc396bff6bd27e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/b8e76bb6cf21459db6e31deeb13e435f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4118b46cc4ef43aeb9e279fbff720a99, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/f14f82389b694c41b52e980d5239428c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7b86c6718c8f453ab7cf9599aa7ba0c0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/8e1528be041c407e941ec664fac5a93d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/24fbb907274742dba90ac0d2bea81cf4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4b7e8c4ebb244553bef78528fc1e7eb6, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_] to archive 2023-11-12 00:54:35,968 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:35,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/088594010029484aa426bde9f52e5b9d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/088594010029484aa426bde9f52e5b9d 2023-11-12 00:54:35,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/054c9244f0bc4d5fb2dc396bff6bd27e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/054c9244f0bc4d5fb2dc396bff6bd27e 2023-11-12 00:54:35,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/b8e76bb6cf21459db6e31deeb13e435f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/b8e76bb6cf21459db6e31deeb13e435f 2023-11-12 00:54:35,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4118b46cc4ef43aeb9e279fbff720a99 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4118b46cc4ef43aeb9e279fbff720a99 2023-11-12 00:54:35,975 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 35 more 2023-11-12 00:54:35,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/f14f82389b694c41b52e980d5239428c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/f14f82389b694c41b52e980d5239428c 2023-11-12 00:54:35,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7b86c6718c8f453ab7cf9599aa7ba0c0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7b86c6718c8f453ab7cf9599aa7ba0c0 2023-11-12 00:54:35,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/8e1528be041c407e941ec664fac5a93d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/8e1528be041c407e941ec664fac5a93d 2023-11-12 00:54:35,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/24fbb907274742dba90ac0d2bea81cf4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/24fbb907274742dba90ac0d2bea81cf4 2023-11-12 00:54:35,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4b7e8c4ebb244553bef78528fc1e7eb6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/4b7e8c4ebb244553bef78528fc1e7eb6 2023-11-12 00:54:35,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e9d579e7fc4b4415980490483b4c6f3d_SeqId_44_ 2023-11-12 00:54:36,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-12 00:54:36,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:36,357 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/.tmp/family1/e04b53a832994a2bae5f273d8052ca11 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e04b53a832994a2bae5f273d8052ca11 2023-11-12 00:54:36,362 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d365b140a0de7324ebb5ec50ebb65fe1/family1 of d365b140a0de7324ebb5ec50ebb65fe1 into e04b53a832994a2bae5f273d8052ca11(size=193.3 K), total size for store is 193.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:54:36,362 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:36,362 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1699750475922; duration=0sec 2023-11-12 00:54:36,362 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:36,428 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-12 00:54:36,429 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:36,429 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-12 00:54:36,431 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-12 00:54:36,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE}] 2023-11-12 00:54:36,433 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE 2023-11-12 00:54:36,434 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:36,434 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750476434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750476434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750476434"}]},"ts":"1699750476434"} 2023-11-12 00:54:36,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:36,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7e36744f390b4df2854db18fa739b740, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7a3a3ba74c6c46e9a460c1a5e4b0bd03, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_] to archive 2023-11-12 00:54:36,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:36,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7e36744f390b4df2854db18fa739b740 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7e36744f390b4df2854db18fa739b740 2023-11-12 00:54:36,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7a3a3ba74c6c46e9a460c1a5e4b0bd03 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/7a3a3ba74c6c46e9a460c1a5e4b0bd03 2023-11-12 00:54:36,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/d0949472f00c4a28adad8630c8395067_SeqId_47_ 2023-11-12 00:54:36,587 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:36,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d365b140a0de7324ebb5ec50ebb65fe1, disabling compactions & flushes 2023-11-12 00:54:36,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. after waiting 0 ms 2023-11-12 00:54:36,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-12 00:54:36,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:36,593 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: d365b140a0de7324ebb5ec50ebb65fe1 to self. 2023-11-12 00:54:36,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=CLOSED 2023-11-12 00:54:36,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750476595"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750476595"}]},"ts":"1699750476595"} 2023-11-12 00:54:36,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-12 00:54:36,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629 in 161 msec 2023-11-12 00:54:36,598 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=true 2023-11-12 00:54:36,748 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:36,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750476748"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750476748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750476748"}]},"ts":"1699750476748"} 2023-11-12 00:54:36,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:36,901 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:36,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d365b140a0de7324ebb5ec50ebb65fe1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:36,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:36,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,906 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,907 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:36,907 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:36,907 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d365b140a0de7324ebb5ec50ebb65fe1 columnFamilyName family1 2023-11-12 00:54:36,912 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e04b53a832994a2bae5f273d8052ca11 2023-11-12 00:54:36,912 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(310): Store=d365b140a0de7324ebb5ec50ebb65fe1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:36,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:36,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d365b140a0de7324ebb5ec50ebb65fe1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73428409, jitterRate=0.09416855871677399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:36,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:36,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., pid=47, masterSystemTime=1699750476901 2023-11-12 00:54:36,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:36,919 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:36,919 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750476919"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750476919"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750476919"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750476919"}]},"ts":"1699750476919"} 2023-11-12 00:54:36,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-12 00:54:36,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629 in 170 msec 2023-11-12 00:54:36,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-12 00:54:36,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE in 489 msec 2023-11-12 00:54:36,925 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-12 00:54:36,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 494 msec 2023-11-12 00:54:36,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 907 msec 2023-11-12 00:54:36,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-12 00:54:36,929 INFO [Listener at localhost/40343] compactions.TestMobCompactor(278): alter status finished 2023-11-12 00:54:36,930 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:36,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:36,931 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:36,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:36,932 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751076932 2023-11-12 00:54:36,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:36,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-12 00:54:36,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:36,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x300e2f4e to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:36,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5874af9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:36,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:36,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:36,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:36,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:36,941 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:37,367 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281172e4cf6fba46028e192a5c475f886a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511281172e4cf6fba46028e192a5c475f886a 2023-11-12 00:54:37,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:37,381 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:37,382 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:37,387 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:37,389 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:37,396 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6ee1d370b3114ae59a6cebc659fe82d3 first=Optional[r05] last=Optional[r8] 2023-11-12 00:54:37,396 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6ee1d370b3114ae59a6cebc659fe82d3}] 2023-11-12 00:54:37,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6ee1d370b3114ae59a6cebc659fe82d3 for inclusion in d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:37,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-12 00:54:37,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:37,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:37,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6ee1d370b3114ae59a6cebc659fe82d3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k9aqf5fq5t1okhv46o013l48qqnldkljh4tosl51oidffpunfj36htlk3to4ab3/family1/6ee1d370b3114ae59a6cebc659fe82d3 2023-11-12 00:54:37,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k9aqf5fq5t1okhv46o013l48qqnldkljh4tosl51oidffpunfj36htlk3to4ab3/family1/6ee1d370b3114ae59a6cebc659fe82d3 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/3ae191d5699d48049caa10acbb052145_SeqId_53_ 2023-11-12 00:54:37,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k9aqf5fq5t1okhv46o013l48qqnldkljh4tosl51oidffpunfj36htlk3to4ab3/family1/6ee1d370b3114ae59a6cebc659fe82d3 into d365b140a0de7324ebb5ec50ebb65fe1/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/3ae191d5699d48049caa10acbb052145_SeqId_53_ - updating store file list. 2023-11-12 00:54:37,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/3ae191d5699d48049caa10acbb052145_SeqId_53_ into d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:37,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k9aqf5fq5t1okhv46o013l48qqnldkljh4tosl51oidffpunfj36htlk3to4ab3/family1/6ee1d370b3114ae59a6cebc659fe82d3 into d365b140a0de7324ebb5ec50ebb65fe1/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/3ae191d5699d48049caa10acbb052145_SeqId_53_) 2023-11-12 00:54:37,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__k9aqf5fq5t1okhv46o013l48qqnldkljh4tosl51oidffpunfj36htlk3to4ab3/family1/6ee1d370b3114ae59a6cebc659fe82d3 2023-11-12 00:54:37,412 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:37,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:37,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fa5e1b624e4c41b29b0e9c8d3075ef16 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fa5e1b624e4c41b29b0e9c8d3075ef16 2023-11-12 00:54:37,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128413b45dac64f492e8b067df376aba3c6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128413b45dac64f492e8b067df376aba3c6 2023-11-12 00:54:37,415 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-12 00:54:37,415 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-12 00:54:37,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:37,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:37,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:37,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:37,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:37,417 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:37,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 487 msec 2023-11-12 00:54:37,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-12 00:54:37,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:37,888 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-12 00:54:37,888 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-12 00:54:37,889 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-12 00:54:37,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-12 00:54:37,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE}] 2023-11-12 00:54:37,894 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE 2023-11-12 00:54:37,894 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:37,894 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750477894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750477894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750477894"}]},"ts":"1699750477894"} 2023-11-12 00:54:37,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:38,047 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:38,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d365b140a0de7324ebb5ec50ebb65fe1, disabling compactions & flushes 2023-11-12 00:54:38,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. after waiting 0 ms 2023-11-12 00:54:38,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-12 00:54:38,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:38,054 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: d365b140a0de7324ebb5ec50ebb65fe1 to self. 2023-11-12 00:54:38,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,056 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=CLOSED 2023-11-12 00:54:38,056 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750478056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750478056"}]},"ts":"1699750478056"} 2023-11-12 00:54:38,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-12 00:54:38,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629 in 161 msec 2023-11-12 00:54:38,059 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=true 2023-11-12 00:54:38,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:38,210 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750478209"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750478209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750478209"}]},"ts":"1699750478209"} 2023-11-12 00:54:38,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:38,363 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:38,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d365b140a0de7324ebb5ec50ebb65fe1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,367 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,368 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:38,368 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1 2023-11-12 00:54:38,368 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d365b140a0de7324ebb5ec50ebb65fe1 columnFamilyName family1 2023-11-12 00:54:38,373 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/3ae191d5699d48049caa10acbb052145_SeqId_53_ 2023-11-12 00:54:38,376 DEBUG [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/family1/e04b53a832994a2bae5f273d8052ca11 2023-11-12 00:54:38,376 INFO [StoreOpener-d365b140a0de7324ebb5ec50ebb65fe1-1] regionserver.HStore(310): Store=d365b140a0de7324ebb5ec50ebb65fe1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:38,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:54:38,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d365b140a0de7324ebb5ec50ebb65fe1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64967419, jitterRate=-0.031910017132759094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:38,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:54:38,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1., pid=53, masterSystemTime=1699750478363 2023-11-12 00:54:38,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:54:38,384 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d365b140a0de7324ebb5ec50ebb65fe1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:38,384 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699750478384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750478384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750478384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750478384"}]},"ts":"1699750478384"} 2023-11-12 00:54:38,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-12 00:54:38,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure d365b140a0de7324ebb5ec50ebb65fe1, server=jenkins-hbase4.apache.org,43681,1699750400629 in 174 msec 2023-11-12 00:54:38,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-12 00:54:38,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d365b140a0de7324ebb5ec50ebb65fe1, REOPEN/MOVE in 494 msec 2023-11-12 00:54:38,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-12 00:54:38,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-11-12 00:54:38,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 912 msec 2023-11-12 00:54:38,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-12 00:54:38,394 INFO [Listener at localhost/40343] compactions.TestMobCompactor(278): alter status finished 2023-11-12 00:54:38,395 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-12 00:54:38,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:38,396 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:38,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:38,397 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751078397 2023-11-12 00:54:38,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:38,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-12 00:54:38,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:38,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x78ac6660 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:38,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d936af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-12 00:54:38,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-12 00:54:38,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:38,407 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-12 00:54:38,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 12 msec 2023-11-12 00:54:38,454 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=245 (was 258), OpenFileDescriptor=634 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=149 (was 191), ProcessCount=171 (was 171), AvailableMemoryMB=872 (was 927) 2023-11-12 00:54:38,465 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=245, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=149, ProcessCount=171, AvailableMemoryMB=871 2023-11-12 00:54:38,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-12 00:54:38,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:38,468 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:54:38,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-12 00:54:38,469 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:54:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-12 00:54:38,470 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:38,470 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 empty. 2023-11-12 00:54:38,471 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:38,471 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-12 00:54:38,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-12 00:54:38,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-12 00:54:38,878 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:38,879 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 53ac21fc7483c88726dff14e6d6ac168, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:39,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-12 00:54:39,285 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:39,285 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 53ac21fc7483c88726dff14e6d6ac168, disabling compactions & flushes 2023-11-12 00:54:39,285 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,285 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,285 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. after waiting 0 ms 2023-11-12 00:54:39,285 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,285 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,285 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:39,287 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:54:39,288 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750479288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750479288"}]},"ts":"1699750479288"} 2023-11-12 00:54:39,289 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:54:39,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:54:39,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750479290"}]},"ts":"1699750479290"} 2023-11-12 00:54:39,291 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-12 00:54:39,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, ASSIGN}] 2023-11-12 00:54:39,295 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, ASSIGN 2023-11-12 00:54:39,296 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:39,446 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:39,447 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750479446"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750479446"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750479446"}]},"ts":"1699750479446"} 2023-11-12 00:54:39,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:39,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-12 00:54:39,599 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:39,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53ac21fc7483c88726dff14e6d6ac168, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,603 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,605 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:39,605 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:39,605 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53ac21fc7483c88726dff14e6d6ac168 columnFamilyName family1 2023-11-12 00:54:39,606 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(310): Store=53ac21fc7483c88726dff14e6d6ac168/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:39,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:39,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:39,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53ac21fc7483c88726dff14e6d6ac168; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69292771, jitterRate=0.03254275023937225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:39,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:39,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., pid=57, masterSystemTime=1699750479599 2023-11-12 00:54:39,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:39,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:39,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750479614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750479614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750479614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750479614"}]},"ts":"1699750479614"} 2023-11-12 00:54:39,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-12 00:54:39,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629 in 168 msec 2023-11-12 00:54:39,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-12 00:54:39,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, ASSIGN in 324 msec 2023-11-12 00:54:39,619 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:54:39,619 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750479619"}]},"ts":"1699750479619"} 2023-11-12 00:54:39,620 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-12 00:54:39,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:54:39,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1560 sec 2023-11-12 00:54:40,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-12 00:54:40,573 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-12 00:54:40,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:40,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,591 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:40,591 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:40,591 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:40,591 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:40,591 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,592 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,594 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:40,594 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:40,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:40,594 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:40,594 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:40,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,595 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:40,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,595 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:40,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:40,596 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:40,596 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:40,597 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:54:41,016 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130af56481dd0f84a6e8d68ead5168bce31 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130af56481dd0f84a6e8d68ead5168bce31 2023-11-12 00:54:41,420 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/aeb231b0b58c4640bd0e5836a2165b58 2023-11-12 00:54:41,424 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/aeb231b0b58c4640bd0e5836a2165b58 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/aeb231b0b58c4640bd0e5836a2165b58 2023-11-12 00:54:41,429 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/aeb231b0b58c4640bd0e5836a2165b58, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-12 00:54:41,430 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 833ms, sequenceid=5, compaction requested=false 2023-11-12 00:54:41,430 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:41,430 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:41,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:41,432 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,432 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:41,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:41,433 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,433 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:41,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:41,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:41,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:41,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:41,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53266aa[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:41,434 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:41,434 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,436 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:41,436 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:41,436 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,436 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:41,444 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:41,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:41,447 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:41,447 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:41,447 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:41,447 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,447 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:41,448 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,448 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,448 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:41,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:41,449 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,450 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,452 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,452 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,452 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,452 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:41,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:41,453 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:41,453 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:41,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:41,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:41,553 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:41,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:41,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:41,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:41,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,559 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:41,559 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:41,559 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:41,559 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:41,560 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,560 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,561 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:41,561 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:41,562 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:41,562 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,563 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,563 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:41,563 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:41,563 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:41,563 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:41,563 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:41,563 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:41,563 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:41,563 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:41,563 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:41,564 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:54:41,976 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128694c6dd45c8e497f87a902dec15a7984 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128694c6dd45c8e497f87a902dec15a7984 2023-11-12 00:54:42,124 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:54:42,381 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/6cc54cfaf5e8426e966619cb2fb53b41 2023-11-12 00:54:42,385 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/6cc54cfaf5e8426e966619cb2fb53b41 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/6cc54cfaf5e8426e966619cb2fb53b41 2023-11-12 00:54:42,389 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/6cc54cfaf5e8426e966619cb2fb53b41, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:54:42,390 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 826ms, sequenceid=9, compaction requested=false 2023-11-12 00:54:42,390 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:42,390 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:42,390 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:42,392 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,392 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:42,393 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,393 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:42,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:42,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:42,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:42,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2d9abd[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:42,394 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:42,394 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,395 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:42,396 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:42,396 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,396 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:42,397 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,397 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:42,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:42,399 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:42,399 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:42,399 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:42,399 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,400 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:42,401 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,401 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:42,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,401 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:42,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:42,402 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:42,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,403 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:42,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:42,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:42,406 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:42,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:42,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:42,507 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:42,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:42,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:42,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:42,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,512 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:42,512 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:42,512 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:42,513 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:42,513 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,513 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:42,514 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:42,515 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:42,515 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:42,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,516 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,516 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:42,516 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:42,516 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:42,516 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:42,516 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:42,516 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:42,929 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a242e51176864def825e3d00ab8991fd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a242e51176864def825e3d00ab8991fd 2023-11-12 00:54:43,335 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/fd0e5a8072f9408da74b31ddefea5fb0 2023-11-12 00:54:43,340 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/fd0e5a8072f9408da74b31ddefea5fb0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fd0e5a8072f9408da74b31ddefea5fb0 2023-11-12 00:54:43,344 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fd0e5a8072f9408da74b31ddefea5fb0, entries=1, sequenceid=13, filesize=5.0 K 2023-11-12 00:54:43,345 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 829ms, sequenceid=13, compaction requested=true 2023-11-12 00:54:43,345 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:43,345 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:43,345 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:43,345 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:43,345 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,345 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:43,345 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:43,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,347 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:43,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,347 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:43,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:43,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12724e1e[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:43,349 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:43,349 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,350 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,350 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:43,350 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:43,350 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:43,350 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,350 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:43,353 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:43,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:43,355 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:43,356 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:43,356 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:43,356 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,356 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:43,357 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,357 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:43,357 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,358 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:43,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:43,359 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:43,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:43,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:43,364 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:43,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:43,364 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,365 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,365 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,365 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,465 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:43,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:43,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:43,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,471 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:43,471 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:43,471 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:43,471 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:43,471 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,471 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,477 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:43,478 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:43,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:43,478 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:43,478 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:43,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:43,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,479 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:43,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:43,479 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:43,479 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:43,480 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:43,891 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120582c83b8813e144faa0de0753e6e27211 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120582c83b8813e144faa0de0753e6e27211 2023-11-12 00:54:44,296 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/45351244dc3644be86933f40312f2fdb 2023-11-12 00:54:44,301 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/45351244dc3644be86933f40312f2fdb as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/45351244dc3644be86933f40312f2fdb 2023-11-12 00:54:44,304 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/45351244dc3644be86933f40312f2fdb, entries=1, sequenceid=17, filesize=5.0 K 2023-11-12 00:54:44,305 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 825ms, sequenceid=17, compaction requested=true 2023-11-12 00:54:44,305 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:44,305 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:44,305 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:44,305 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:44,305 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,305 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:44,305 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:44,307 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,307 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,308 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:44,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:44,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314470db[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:44,309 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:44,309 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,310 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,310 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:44,310 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:44,310 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:44,310 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,310 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:44,312 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:44,312 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,312 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:44,312 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:44,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:44,314 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:44,314 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:44,314 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:44,314 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,314 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:44,317 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,317 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:44,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,317 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:44,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:44,317 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,318 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:44,321 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:44,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:44,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:44,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:44,321 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:44,422 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:44,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:44,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:44,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:44,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,427 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:44,427 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:44,427 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:44,427 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:44,428 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,428 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,429 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,429 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:44,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:44,429 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:44,429 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:44,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,430 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,430 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:44,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:44,431 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:44,431 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:44,431 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:44,842 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d2ae179e68de4f549034ce18149b894b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228d2ae179e68de4f549034ce18149b894b 2023-11-12 00:54:45,248 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/18b66990422c4cd596d8f9732d9df938 2023-11-12 00:54:45,253 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/18b66990422c4cd596d8f9732d9df938 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/18b66990422c4cd596d8f9732d9df938 2023-11-12 00:54:45,258 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/18b66990422c4cd596d8f9732d9df938, entries=1, sequenceid=21, filesize=5.0 K 2023-11-12 00:54:45,259 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 828ms, sequenceid=21, compaction requested=true 2023-11-12 00:54:45,259 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:45,259 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:45,259 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:45,260 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:45,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:45,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d5476f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:45,263 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:45,263 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,264 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,265 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:45,265 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:45,265 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:45,265 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,265 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:45,266 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,266 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:45,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:45,269 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:45,269 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:45,269 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:45,269 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,269 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:45,271 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,271 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,271 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:45,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:45,271 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,272 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,275 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:45,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:45,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:45,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:45,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:45,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:45,275 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:45,376 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:45,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:45,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:45,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:45,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,381 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:45,381 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:45,381 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:45,381 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:45,382 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,382 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,384 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:45,384 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:45,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:45,384 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:45,384 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:45,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:45,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,385 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,385 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:45,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:45,385 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:45,385 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:45,385 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:45,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:45,386 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:45,386 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:45,386 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:45,386 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:45,797 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c35d9d110f7b4b0ca434ac9789c6e2d9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c35d9d110f7b4b0ca434ac9789c6e2d9 2023-11-12 00:54:46,203 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/9a91e1dd3e0b433fba1981b662579819 2023-11-12 00:54:46,207 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/9a91e1dd3e0b433fba1981b662579819 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/9a91e1dd3e0b433fba1981b662579819 2023-11-12 00:54:46,211 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/9a91e1dd3e0b433fba1981b662579819, entries=1, sequenceid=25, filesize=5.0 K 2023-11-12 00:54:46,212 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 826ms, sequenceid=25, compaction requested=true 2023-11-12 00:54:46,212 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:46,212 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:46,212 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:46,213 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,213 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,214 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:46,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:46,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50dad95a[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:46,215 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:46,215 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,216 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:46,217 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:46,217 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,217 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:46,218 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:46,218 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:46,218 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,218 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:46,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:46,220 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:46,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:46,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:46,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,220 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:46,223 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,223 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:46,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,223 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:46,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:46,223 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:46,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:46,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,224 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:46,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,227 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:46,227 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:46,228 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:46,229 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:46,229 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:46,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:46,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:46,328 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:46,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:46,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:46,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:46,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,333 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:46,333 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:46,333 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:46,333 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:46,334 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,334 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,335 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:46,335 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:46,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:46,335 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:46,335 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:46,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:46,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:46,336 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:46,336 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:46,336 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:46,337 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:46,337 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:46,337 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:46,337 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:46,337 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:46,748 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a9bfc820a7eb44f6bc7c366feafd4d45 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101a9bfc820a7eb44f6bc7c366feafd4d45 2023-11-12 00:54:47,154 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/fdf29d68c4704f0b8ba5f25c11d45f75 2023-11-12 00:54:47,158 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/fdf29d68c4704f0b8ba5f25c11d45f75 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fdf29d68c4704f0b8ba5f25c11d45f75 2023-11-12 00:54:47,162 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fdf29d68c4704f0b8ba5f25c11d45f75, entries=1, sequenceid=29, filesize=5.0 K 2023-11-12 00:54:47,163 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 826ms, sequenceid=29, compaction requested=true 2023-11-12 00:54:47,163 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:47,163 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,165 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:47,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:47,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d86fe1[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:47,166 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:47,166 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,168 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:47,168 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,168 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:47,170 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,170 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:47,170 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:47,170 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:47,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:47,172 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:47,172 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:47,172 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:47,172 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,172 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:47,173 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,173 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,174 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:47,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:47,174 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,175 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,177 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,177 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:47,177 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,177 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:47,178 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:47,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:47,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-12 00:54:47,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:47,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:47,177 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,178 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,178 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:47,178 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,178 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:47,178 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:47,178 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,278 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:47,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:47,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:47,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:47,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,284 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:47,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:47,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:47,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:47,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,287 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,287 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:47,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:47,287 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:47,287 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,288 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:47,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:47,288 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:47,288 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:47,289 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:47,289 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:47,700 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032880c4c98cfc48c293b449a48a6c2744 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601032880c4c98cfc48c293b449a48a6c2744 2023-11-12 00:54:48,105 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/bc9f438537974f7999f697cf51769bc7 2023-11-12 00:54:48,109 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/bc9f438537974f7999f697cf51769bc7 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/bc9f438537974f7999f697cf51769bc7 2023-11-12 00:54:48,114 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/bc9f438537974f7999f697cf51769bc7, entries=1, sequenceid=33, filesize=5.0 K 2023-11-12 00:54:48,115 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 826ms, sequenceid=33, compaction requested=true 2023-11-12 00:54:48,115 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:48,115 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:48,115 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:48,115 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:48,115 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,115 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:48,115 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:48,117 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:48,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:48,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42080f89[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:48,119 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:48,119 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,120 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:48,120 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,120 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:48,124 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:48,124 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,124 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:48,125 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:48,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:48,127 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:48,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:48,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:48,127 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,127 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:48,129 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,129 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,129 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:48,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:48,129 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,130 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,133 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:48,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:48,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:48,133 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:48,134 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:48,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-12 00:54:48,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:48,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:48,234 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:48,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:48,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:48,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:48,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,240 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:48,240 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:48,240 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:48,240 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:48,240 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,240 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,241 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:48,241 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:48,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:48,242 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:48,242 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:48,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:48,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:48,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:48,243 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:48,243 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:48,243 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:48,243 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:48,658 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076c4bb77eaabe4a5d88705ef55200ca8c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509076c4bb77eaabe4a5d88705ef55200ca8c 2023-11-12 00:54:49,064 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/ab233567e7114321848ba2ad6eed3ed9 2023-11-12 00:54:49,070 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/ab233567e7114321848ba2ad6eed3ed9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/ab233567e7114321848ba2ad6eed3ed9 2023-11-12 00:54:49,074 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/ab233567e7114321848ba2ad6eed3ed9, entries=1, sequenceid=37, filesize=5.0 K 2023-11-12 00:54:49,074 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 831ms, sequenceid=37, compaction requested=true 2023-11-12 00:54:49,075 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:49,075 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:49,075 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:49,075 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:49,075 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,075 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:49,075 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:49,078 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,078 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:49,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:49,078 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,078 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:49,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:49,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:49,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:49,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4febd698[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:49,079 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:49,079 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,081 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:49,081 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:49,081 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,081 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:49,082 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:49,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:49,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:49,082 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:49,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:49,085 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:49,085 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:49,085 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:49,085 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,085 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:49,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,086 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:49,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:49,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:49,087 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,088 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:49,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:49,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:49,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-12 00:54:49,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:49,091 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:49,091 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:49,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:49,092 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,092 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,192 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:49,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:49,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:54:49,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-12 00:54:49,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,197 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:49,197 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:49,197 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-12 00:54:49,197 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-12 00:54:49,197 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,197 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,199 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:49,199 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:49,199 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:49,199 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:54:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:54:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,200 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,200 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-12 00:54:49,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-12 00:54:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:54:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-12 00:54:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:54:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:54:49,200 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:49,200 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. started... 2023-11-12 00:54:49,200 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 53ac21fc7483c88726dff14e6d6ac168 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:54:49,612 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d478aa17c3194e30a3bf438b91a4eced to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120d478aa17c3194e30a3bf438b91a4eced 2023-11-12 00:54:50,017 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/21f5df99b0914ff091f892266626299d 2023-11-12 00:54:50,021 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/21f5df99b0914ff091f892266626299d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/21f5df99b0914ff091f892266626299d 2023-11-12 00:54:50,025 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/21f5df99b0914ff091f892266626299d, entries=1, sequenceid=41, filesize=5.0 K 2023-11-12 00:54:50,025 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 53ac21fc7483c88726dff14e6d6ac168 in 825ms, sequenceid=41, compaction requested=true 2023-11-12 00:54:50,025 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:50,026 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:54:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:54:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-12 00:54:50,026 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-12 00:54:50,027 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,027 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,028 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:50,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:50,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-12 00:54:50,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@497dc636[Count = 0] remaining members to acquire global barrier 2023-11-12 00:54:50,029 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-12 00:54:50,029 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-12 00:54:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-12 00:54:50,030 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:54:50,030 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,031 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:54:50,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-12 00:54:50,033 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:50,033 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-12 00:54:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:50,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:50,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:54:50,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-12 00:54:50,035 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-12 00:54:50,035 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:54:50,035 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:54:50,035 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,035 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:54:50,037 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,037 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:54:50,037 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:50,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:54:50,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:50,037 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,038 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:54:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:54:50,043 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:54:50,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:54:50,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-12 00:54:50,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:54:50,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:54:50,043 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-12 00:54:50,044 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:54:50,144 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:54:50,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:54:50,145 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:50,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:50,147 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:50,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:50,148 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751090148 2023-11-12 00:54:50,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:50,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-12 00:54:50,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:50,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x04712f66 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:50,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f44834e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:50,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:50,989 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ca5e11248764349834391db487572d0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601034ca5e11248764349834391db487572d0 2023-11-12 00:54:50,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:51,002 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:51,003 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:51,009 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:51,010 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:51,018 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9ca76c53b86a4db8a56dd24277b253d5 first=Optional[r3] last=Optional[r6] 2023-11-12 00:54:51,019 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9ca76c53b86a4db8a56dd24277b253d5}] 2023-11-12 00:54:51,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9ca76c53b86a4db8a56dd24277b253d5 for inclusion in 53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:51,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-12 00:54:51,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:51,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:51,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9ca76c53b86a4db8a56dd24277b253d5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugd5pnbtj0kj2hlg0s2t1f67a0498n1qi1csfkg0e15ahr0cc3np6r4r77nnnh0m/family1/9ca76c53b86a4db8a56dd24277b253d5 2023-11-12 00:54:51,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugd5pnbtj0kj2hlg0s2t1f67a0498n1qi1csfkg0e15ahr0cc3np6r4r77nnnh0m/family1/9ca76c53b86a4db8a56dd24277b253d5 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_ 2023-11-12 00:54:51,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugd5pnbtj0kj2hlg0s2t1f67a0498n1qi1csfkg0e15ahr0cc3np6r4r77nnnh0m/family1/9ca76c53b86a4db8a56dd24277b253d5 into 53ac21fc7483c88726dff14e6d6ac168/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_ - updating store file list. 2023-11-12 00:54:51,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_ into 53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:51,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugd5pnbtj0kj2hlg0s2t1f67a0498n1qi1csfkg0e15ahr0cc3np6r4r77nnnh0m/family1/9ca76c53b86a4db8a56dd24277b253d5 into 53ac21fc7483c88726dff14e6d6ac168/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_) 2023-11-12 00:54:51,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ugd5pnbtj0kj2hlg0s2t1f67a0498n1qi1csfkg0e15ahr0cc3np6r4r77nnnh0m/family1/9ca76c53b86a4db8a56dd24277b253d5 2023-11-12 00:54:51,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:54:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:54:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 53ac21fc7483c88726dff14e6d6ac168/family1 is initiating minor compaction 2023-11-12 00:54:51,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8d595e0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:51,034 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53ac21fc7483c88726dff14e6d6ac168/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:51,035 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/6cc54cfaf5e8426e966619cb2fb53b41, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fd0e5a8072f9408da74b31ddefea5fb0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/45351244dc3644be86933f40312f2fdb, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/18b66990422c4cd596d8f9732d9df938, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/9a91e1dd3e0b433fba1981b662579819, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fdf29d68c4704f0b8ba5f25c11d45f75, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/bc9f438537974f7999f697cf51769bc7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/ab233567e7114321848ba2ad6eed3ed9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/21f5df99b0914ff091f892266626299d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp, totalSize=50.3 K 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 6cc54cfaf5e8426e966619cb2fb53b41, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting fd0e5a8072f9408da74b31ddefea5fb0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 45351244dc3644be86933f40312f2fdb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 18b66990422c4cd596d8f9732d9df938, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 9a91e1dd3e0b433fba1981b662579819, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting fdf29d68c4704f0b8ba5f25c11d45f75, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting bc9f438537974f7999f697cf51769bc7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting ab233567e7114321848ba2ad6eed3ed9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 21f5df99b0914ff091f892266626299d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:54:51,035 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:54:51,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:51,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:51,038 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228d2ae179e68de4f549034ce18149b894b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228d2ae179e68de4f549034ce18149b894b 2023-11-12 00:54:51,040 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c35d9d110f7b4b0ca434ac9789c6e2d9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c35d9d110f7b4b0ca434ac9789c6e2d9 2023-11-12 00:54:51,041 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101a9bfc820a7eb44f6bc7c366feafd4d45 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101a9bfc820a7eb44f6bc7c366feafd4d45 2023-11-12 00:54:51,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601032880c4c98cfc48c293b449a48a6c2744 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601032880c4c98cfc48c293b449a48a6c2744 2023-11-12 00:54:51,042 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-12 00:54:51,042 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,068 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53ac21fc7483c88726dff14e6d6ac168#family1#compaction#73 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:51,886 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/3fd36a2035524bf0b0d15455650c0012 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/3fd36a2035524bf0b0d15455650c0012 2023-11-12 00:54:51,891 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 53ac21fc7483c88726dff14e6d6ac168/family1 of 53ac21fc7483c88726dff14e6d6ac168 into 3fd36a2035524bf0b0d15455650c0012(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:54:51,891 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:51,891 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699750491034; duration=0sec 2023-11-12 00:54:51,891 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:51,896 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cc2004fcfabe49d2ba09c9bb203229ce to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc2004fcfabe49d2ba09c9bb203229ce 2023-11-12 00:54:51,897 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:51,925 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd0a7d86ad7440ad92d2edc76d5167b2 first=Optional[r00] last=Optional[r2] 2023-11-12 00:54:51,926 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd0a7d86ad7440ad92d2edc76d5167b2}] 2023-11-12 00:54:51,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd0a7d86ad7440ad92d2edc76d5167b2 for inclusion in 53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-12 00:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:51,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd0a7d86ad7440ad92d2edc76d5167b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hi60c342e83jl96jdjunmh87sl49l5u9v69dpg76ll8sgcbb3mvbhcdbhnqq2fho/family1/bd0a7d86ad7440ad92d2edc76d5167b2 2023-11-12 00:54:51,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hi60c342e83jl96jdjunmh87sl49l5u9v69dpg76ll8sgcbb3mvbhcdbhnqq2fho/family1/bd0a7d86ad7440ad92d2edc76d5167b2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_ 2023-11-12 00:54:51,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hi60c342e83jl96jdjunmh87sl49l5u9v69dpg76ll8sgcbb3mvbhcdbhnqq2fho/family1/bd0a7d86ad7440ad92d2edc76d5167b2 into 53ac21fc7483c88726dff14e6d6ac168/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_ - updating store file list. 2023-11-12 00:54:51,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_ into 53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:51,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hi60c342e83jl96jdjunmh87sl49l5u9v69dpg76ll8sgcbb3mvbhcdbhnqq2fho/family1/bd0a7d86ad7440ad92d2edc76d5167b2 into 53ac21fc7483c88726dff14e6d6ac168/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_) 2023-11-12 00:54:51,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hi60c342e83jl96jdjunmh87sl49l5u9v69dpg76ll8sgcbb3mvbhcdbhnqq2fho/family1/bd0a7d86ad7440ad92d2edc76d5167b2 2023-11-12 00:54:51,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:54:51,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:54:51,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 53ac21fc7483c88726dff14e6d6ac168/family1 is initiating minor compaction (all files) 2023-11-12 00:54:51,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@941d9be; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:51,939 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 53ac21fc7483c88726dff14e6d6ac168/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:51,939 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/aeb231b0b58c4640bd0e5836a2165b58, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/3fd36a2035524bf0b0d15455650c0012, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp, totalSize=388.1 K 2023-11-12 00:54:51,939 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting aeb231b0b58c4640bd0e5836a2165b58, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:54:51,940 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 3fd36a2035524bf0b0d15455650c0012, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:54:51,940 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 091a874c6ff6430296c46c210c815ea8_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823723 2023-11-12 00:54:51,940 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:51,941 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:51,942 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130af56481dd0f84a6e8d68ead5168bce31 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130af56481dd0f84a6e8d68ead5168bce31 2023-11-12 00:54:51,944 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a242e51176864def825e3d00ab8991fd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201a242e51176864def825e3d00ab8991fd 2023-11-12 00:54:51,949 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120582c83b8813e144faa0de0753e6e27211 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120582c83b8813e144faa0de0753e6e27211 2023-11-12 00:54:51,949 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-12 00:54:51,949 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-12 00:54:51,949 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:51,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:51,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:51,954 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:51,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8080 sec 2023-11-12 00:54:51,960 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 53ac21fc7483c88726dff14e6d6ac168#family1#compaction#74 average throughput is 13.82 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:51,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/6cc54cfaf5e8426e966619cb2fb53b41, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fd0e5a8072f9408da74b31ddefea5fb0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/45351244dc3644be86933f40312f2fdb, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/18b66990422c4cd596d8f9732d9df938, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/9a91e1dd3e0b433fba1981b662579819, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fdf29d68c4704f0b8ba5f25c11d45f75, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/bc9f438537974f7999f697cf51769bc7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/ab233567e7114321848ba2ad6eed3ed9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/21f5df99b0914ff091f892266626299d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_] to archive 2023-11-12 00:54:51,973 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:51,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/6cc54cfaf5e8426e966619cb2fb53b41 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/6cc54cfaf5e8426e966619cb2fb53b41 2023-11-12 00:54:51,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fd0e5a8072f9408da74b31ddefea5fb0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fd0e5a8072f9408da74b31ddefea5fb0 2023-11-12 00:54:51,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/45351244dc3644be86933f40312f2fdb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/45351244dc3644be86933f40312f2fdb 2023-11-12 00:54:51,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/18b66990422c4cd596d8f9732d9df938 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/18b66990422c4cd596d8f9732d9df938 2023-11-12 00:54:51,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/9a91e1dd3e0b433fba1981b662579819 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/9a91e1dd3e0b433fba1981b662579819 2023-11-12 00:54:51,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fdf29d68c4704f0b8ba5f25c11d45f75 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/fdf29d68c4704f0b8ba5f25c11d45f75 2023-11-12 00:54:51,982 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-12 00:54:51,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/bc9f438537974f7999f697cf51769bc7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/bc9f438537974f7999f697cf51769bc7 2023-11-12 00:54:51,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/ab233567e7114321848ba2ad6eed3ed9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/ab233567e7114321848ba2ad6eed3ed9 2023-11-12 00:54:51,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/21f5df99b0914ff091f892266626299d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/21f5df99b0914ff091f892266626299d 2023-11-12 00:54:51,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/e311c7fc31e24f9ca2223ca24b365cb7_SeqId_44_ 2023-11-12 00:54:52,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-12 00:54:52,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:52,434 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-12 00:54:52,434 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:52,434 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-12 00:54:52,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-12 00:54:52,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE}] 2023-11-12 00:54:52,440 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE 2023-11-12 00:54:52,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:52,441 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750492440"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750492440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750492440"}]},"ts":"1699750492440"} 2023-11-12 00:54:52,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:52,593 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:52,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:52,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53ac21fc7483c88726dff14e6d6ac168, disabling compactions & flushes 2023-11-12 00:54:52,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,186 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/.tmp/family1/20cafaca6489401e922d03fc287a7ad2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/20cafaca6489401e922d03fc287a7ad2 2023-11-12 00:54:53,191 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 53ac21fc7483c88726dff14e6d6ac168/family1 of 53ac21fc7483c88726dff14e6d6ac168 into 20cafaca6489401e922d03fc287a7ad2(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:54:53,191 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:53,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,191 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1699750491939; duration=1sec 2023-11-12 00:54:53,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,191 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:53,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. after waiting 0 ms 2023-11-12 00:54:53,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,194 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/aeb231b0b58c4640bd0e5836a2165b58, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/3fd36a2035524bf0b0d15455650c0012, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_] to archive 2023-11-12 00:54:53,195 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:53,196 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/aeb231b0b58c4640bd0e5836a2165b58 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/aeb231b0b58c4640bd0e5836a2165b58 2023-11-12 00:54:53,197 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/3fd36a2035524bf0b0d15455650c0012 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/3fd36a2035524bf0b0d15455650c0012 2023-11-12 00:54:53,198 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/091a874c6ff6430296c46c210c815ea8_SeqId_47_ 2023-11-12 00:54:53,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-12 00:54:53,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:53,203 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 53ac21fc7483c88726dff14e6d6ac168 to self. 2023-11-12 00:54:53,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,205 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=CLOSED 2023-11-12 00:54:53,205 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750493205"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750493205"}]},"ts":"1699750493205"} 2023-11-12 00:54:53,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-12 00:54:53,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629 in 764 msec 2023-11-12 00:54:53,207 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=true 2023-11-12 00:54:53,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:53,358 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750493357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750493357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750493357"}]},"ts":"1699750493357"} 2023-11-12 00:54:53,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:53,510 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:53,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53ac21fc7483c88726dff14e6d6ac168, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,514 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,515 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:53,515 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:53,515 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53ac21fc7483c88726dff14e6d6ac168 columnFamilyName family1 2023-11-12 00:54:53,519 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/20cafaca6489401e922d03fc287a7ad2 2023-11-12 00:54:53,520 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(310): Store=53ac21fc7483c88726dff14e6d6ac168/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:53,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:53,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53ac21fc7483c88726dff14e6d6ac168; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60359499, jitterRate=-0.10057337582111359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:53,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:53,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., pid=63, masterSystemTime=1699750493510 2023-11-12 00:54:53,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:53,526 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:53,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750493526"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750493526"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750493526"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750493526"}]},"ts":"1699750493526"} 2023-11-12 00:54:53,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-12 00:54:53,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629 in 168 msec 2023-11-12 00:54:53,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-12 00:54:53,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE in 1.0900 sec 2023-11-12 00:54:53,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-12 00:54:53,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0940 sec 2023-11-12 00:54:53,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5080 sec 2023-11-12 00:54:53,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-12 00:54:53,534 INFO [Listener at localhost/40343] compactions.TestMobCompactor(278): alter status finished 2023-11-12 00:54:53,535 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:53,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:53,537 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:53,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:53,537 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751093537 2023-11-12 00:54:53,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:53,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-12 00:54:53,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:53,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x7e601b26 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:53,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36d9db1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:53,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:53,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:53,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:53,544 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:53,544 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:53,966 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282fd6e21b6a5c4174bd1e5ed0735e1c62 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511282fd6e21b6a5c4174bd1e5ed0735e1c62 2023-11-12 00:54:53,966 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:53,979 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:53,980 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:53,985 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:53,986 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:53,995 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/414c280e578142b085dffea12a14d9a8 first=Optional[r05] last=Optional[r8] 2023-11-12 00:54:53,995 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/414c280e578142b085dffea12a14d9a8}] 2023-11-12 00:54:53,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/414c280e578142b085dffea12a14d9a8 for inclusion in 53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:54,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-12 00:54:54,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:54,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:54,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/414c280e578142b085dffea12a14d9a8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eam1fnlkusml33vmb9vuhtoti0hjmmis1k7v0n5elsfqe99h2rqk953gpu8ntpdk/family1/414c280e578142b085dffea12a14d9a8 2023-11-12 00:54:54,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eam1fnlkusml33vmb9vuhtoti0hjmmis1k7v0n5elsfqe99h2rqk953gpu8ntpdk/family1/414c280e578142b085dffea12a14d9a8 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/7a11827de9be4969a7347fe13de7e857_SeqId_53_ 2023-11-12 00:54:54,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eam1fnlkusml33vmb9vuhtoti0hjmmis1k7v0n5elsfqe99h2rqk953gpu8ntpdk/family1/414c280e578142b085dffea12a14d9a8 into 53ac21fc7483c88726dff14e6d6ac168/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/7a11827de9be4969a7347fe13de7e857_SeqId_53_ - updating store file list. 2023-11-12 00:54:54,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/7a11827de9be4969a7347fe13de7e857_SeqId_53_ into 53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:54,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eam1fnlkusml33vmb9vuhtoti0hjmmis1k7v0n5elsfqe99h2rqk953gpu8ntpdk/family1/414c280e578142b085dffea12a14d9a8 into 53ac21fc7483c88726dff14e6d6ac168/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/7a11827de9be4969a7347fe13de7e857_SeqId_53_) 2023-11-12 00:54:54,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eam1fnlkusml33vmb9vuhtoti0hjmmis1k7v0n5elsfqe99h2rqk953gpu8ntpdk/family1/414c280e578142b085dffea12a14d9a8 2023-11-12 00:54:54,014 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:54,015 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:54,017 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120d478aa17c3194e30a3bf438b91a4eced to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120d478aa17c3194e30a3bf438b91a4eced 2023-11-12 00:54:54,018 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128694c6dd45c8e497f87a902dec15a7984 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128694c6dd45c8e497f87a902dec15a7984 2023-11-12 00:54:54,018 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-12 00:54:54,018 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-12 00:54:54,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:54,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:54,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:54,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:54,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:54,020 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:54,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 485 msec 2023-11-12 00:54:54,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-12 00:54:54,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:54,493 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-12 00:54:54,494 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-12 00:54:54,494 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-12 00:54:54,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-12 00:54:54,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE}] 2023-11-12 00:54:54,499 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE 2023-11-12 00:54:54,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:54,499 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750494499"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750494499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750494499"}]},"ts":"1699750494499"} 2023-11-12 00:54:54,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:54,651 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53ac21fc7483c88726dff14e6d6ac168, disabling compactions & flushes 2023-11-12 00:54:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. after waiting 0 ms 2023-11-12 00:54:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-12 00:54:54,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:54,658 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 53ac21fc7483c88726dff14e6d6ac168 to self. 2023-11-12 00:54:54,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,659 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=CLOSED 2023-11-12 00:54:54,659 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750494659"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750494659"}]},"ts":"1699750494659"} 2023-11-12 00:54:54,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-12 00:54:54,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629 in 160 msec 2023-11-12 00:54:54,662 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=true 2023-11-12 00:54:54,812 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:54,812 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750494812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750494812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750494812"}]},"ts":"1699750494812"} 2023-11-12 00:54:54,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:54,965 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:54,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 53ac21fc7483c88726dff14e6d6ac168, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:54,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:54,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,969 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,970 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:54,970 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1 2023-11-12 00:54:54,971 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 53ac21fc7483c88726dff14e6d6ac168 columnFamilyName family1 2023-11-12 00:54:54,975 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/20cafaca6489401e922d03fc287a7ad2 2023-11-12 00:54:54,978 DEBUG [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/family1/7a11827de9be4969a7347fe13de7e857_SeqId_53_ 2023-11-12 00:54:54,978 INFO [StoreOpener-53ac21fc7483c88726dff14e6d6ac168-1] regionserver.HStore(310): Store=53ac21fc7483c88726dff14e6d6ac168/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:54,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:54:54,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 53ac21fc7483c88726dff14e6d6ac168; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69730678, jitterRate=0.0390680730342865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:54,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:54:54,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168., pid=69, masterSystemTime=1699750494965 2023-11-12 00:54:54,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:54:54,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=53ac21fc7483c88726dff14e6d6ac168, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:54,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699750494985"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750494985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750494985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750494985"}]},"ts":"1699750494985"} 2023-11-12 00:54:54,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-12 00:54:54,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 53ac21fc7483c88726dff14e6d6ac168, server=jenkins-hbase4.apache.org,43681,1699750400629 in 172 msec 2023-11-12 00:54:54,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-12 00:54:54,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=53ac21fc7483c88726dff14e6d6ac168, REOPEN/MOVE in 489 msec 2023-11-12 00:54:54,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-12 00:54:54,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 493 msec 2023-11-12 00:54:54,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 907 msec 2023-11-12 00:54:54,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-12 00:54:54,994 INFO [Listener at localhost/40343] compactions.TestMobCompactor(278): alter status finished 2023-11-12 00:54:54,994 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-12 00:54:54,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:54,996 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:54,997 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751094997 2023-11-12 00:54:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:54:54,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-12 00:54:54,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:55,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x1b5e3d6e to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:55,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@185093a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-12 00:54:55,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-12 00:54:55,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:55,006 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-12 00:54:55,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-11-12 00:54:55,054 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=254 (was 245) - Thread LEAK? -, OpenFileDescriptor=670 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 149), ProcessCount=171 (was 171), AvailableMemoryMB=864 (was 871) 2023-11-12 00:54:55,067 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=254, OpenFileDescriptor=670, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=171, AvailableMemoryMB=864 2023-11-12 00:54:55,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-12 00:54:55,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-12 00:54:55,073 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:54:55,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-12 00:54:55,074 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:54:55,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-12 00:54:55,075 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:55,075 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 empty. 2023-11-12 00:54:55,076 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:55,076 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-12 00:54:55,227 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:55,227 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-12 00:54:55,227 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e601b26 to 127.0.0.1:60532 2023-11-12 00:54:55,228 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:55,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b5e3d6e to 127.0.0.1:60532 2023-11-12 00:54:55,228 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:55,228 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:55,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04712f66 to 127.0.0.1:60532 2023-11-12 00:54:55,228 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:55,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-12 00:54:55,228 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:55,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x300e2f4e to 127.0.0.1:60532 2023-11-12 00:54:55,228 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:55,228 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78ac6660 to 127.0.0.1:60532 2023-11-12 00:54:55,228 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:55,229 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:54:55,229 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fdc7b96 to 127.0.0.1:60532 2023-11-12 00:54:55,229 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:54:55,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-12 00:54:55,630 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-12 00:54:55,632 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4a18401752b50e23a68b0f93c34cf917, NAME => 'testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:54:55,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-12 00:54:56,038 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:56,038 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 4a18401752b50e23a68b0f93c34cf917, disabling compactions & flushes 2023-11-12 00:54:56,038 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,038 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,038 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. after waiting 0 ms 2023-11-12 00:54:56,038 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,039 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,039 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:54:56,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:54:56,042 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699750496042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750496042"}]},"ts":"1699750496042"} 2023-11-12 00:54:56,043 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:54:56,044 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:54:56,044 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750496044"}]},"ts":"1699750496044"} 2023-11-12 00:54:56,045 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-12 00:54:56,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, ASSIGN}] 2023-11-12 00:54:56,050 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, ASSIGN 2023-11-12 00:54:56,050 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:54:56,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=4a18401752b50e23a68b0f93c34cf917, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:56,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699750496201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750496201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750496201"}]},"ts":"1699750496201"} 2023-11-12 00:54:56,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 4a18401752b50e23a68b0f93c34cf917, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:54:56,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-12 00:54:56,354 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:56,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a18401752b50e23a68b0f93c34cf917, NAME => 'testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:54:56,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-12 00:54:56,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-12 00:54:56,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:54:56,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,361 INFO [StoreOpener-4a18401752b50e23a68b0f93c34cf917-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,362 DEBUG [StoreOpener-4a18401752b50e23a68b0f93c34cf917-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1 2023-11-12 00:54:56,362 DEBUG [StoreOpener-4a18401752b50e23a68b0f93c34cf917-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1 2023-11-12 00:54:56,363 INFO [StoreOpener-4a18401752b50e23a68b0f93c34cf917-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a18401752b50e23a68b0f93c34cf917 columnFamilyName f1 2023-11-12 00:54:56,364 INFO [StoreOpener-4a18401752b50e23a68b0f93c34cf917-1] regionserver.HStore(310): Store=4a18401752b50e23a68b0f93c34cf917/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:54:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:54:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:54:56,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a18401752b50e23a68b0f93c34cf917; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64355492, jitterRate=-0.04102843999862671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:54:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:54:56,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917., pid=73, masterSystemTime=1699750496354 2023-11-12 00:54:56,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:56,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=4a18401752b50e23a68b0f93c34cf917, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:54:56,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699750496372"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750496372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750496372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750496372"}]},"ts":"1699750496372"} 2023-11-12 00:54:56,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-12 00:54:56,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 4a18401752b50e23a68b0f93c34cf917, server=jenkins-hbase4.apache.org,43681,1699750400629 in 171 msec 2023-11-12 00:54:56,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-12 00:54:56,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, ASSIGN in 327 msec 2023-11-12 00:54:56,377 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:54:56,377 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750496377"}]},"ts":"1699750496377"} 2023-11-12 00:54:56,377 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-12 00:54:56,379 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:54:56,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.3090 sec 2023-11-12 00:54:57,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-12 00:54:57,232 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-12 00:54:57,232 DEBUG [Listener at localhost/40343] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-12 00:54:57,234 INFO [Listener at localhost/40343] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-12 00:54:57,237 INFO [Listener at localhost/40343] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-12 00:54:57,237 INFO [Listener at localhost/40343] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-12 00:54:57,238 INFO [Listener at localhost/40343] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-12 00:54:57,241 INFO [Listener at localhost/40343] regionserver.HRegion(2745): Flushing 4a18401752b50e23a68b0f93c34cf917 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-12 00:54:57,254 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112056cf44fb9bf42ce9b4102111478e26c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231112056cf44fb9bf42ce9b4102111478e26c 2023-11-12 00:54:57,663 INFO [Listener at localhost/40343] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/.tmp/f1/20a55597d4524ab688e5bd1ce638e2e3 2023-11-12 00:54:57,668 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/.tmp/f1/20a55597d4524ab688e5bd1ce638e2e3 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3 2023-11-12 00:54:57,672 INFO [Listener at localhost/40343] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3, entries=1, sequenceid=5, filesize=4.9 K 2023-11-12 00:54:57,673 INFO [Listener at localhost/40343] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 4a18401752b50e23a68b0f93c34cf917 in 432ms, sequenceid=5, compaction requested=false 2023-11-12 00:54:57,674 DEBUG [Listener at localhost/40343] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-12 00:54:57,674 DEBUG [Listener at localhost/40343] regionserver.HRegion(2446): Flush status journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:54:57,676 INFO [Listener at localhost/40343] regionserver.HRegion(2745): Flushing 4a18401752b50e23a68b0f93c34cf917 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-12 00:54:58,101 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311124516c650740d4e8ba416f6c9ac63c422 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311124516c650740d4e8ba416f6c9ac63c422 2023-11-12 00:54:58,507 INFO [Listener at localhost/40343] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/.tmp/f1/e83e499a394449b0bba2f6e43126ffce 2023-11-12 00:54:58,511 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/.tmp/f1/e83e499a394449b0bba2f6e43126ffce as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce 2023-11-12 00:54:58,514 INFO [Listener at localhost/40343] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce, entries=1, sequenceid=9, filesize=4.9 K 2023-11-12 00:54:58,515 INFO [Listener at localhost/40343] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 4a18401752b50e23a68b0f93c34cf917 in 839ms, sequenceid=9, compaction requested=false 2023-11-12 00:54:58,515 DEBUG [Listener at localhost/40343] regionserver.HRegion(2446): Flush status journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:54:58,517 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-12 00:54:58,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-12 00:54:58,518 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-12 00:54:58,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:58,519 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751098519 2023-11-12 00:54:58,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-12 00:54:58,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-12 00:54:58,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-12 00:54:58,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x5bf8639a to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:54:58,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@729d6d06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:54:58,525 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231112 for table='testGetAfterCompaction' and column='f1' 2023-11-12 00:54:58,568 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,568 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,618 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,619 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,669 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,669 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,720 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,720 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,744 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:54:58,770 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,771 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,821 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,821 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,872 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,872 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,923 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,923 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,973 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:58,973 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,024 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,025 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,075 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,075 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,126 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,126 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,177 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,177 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,228 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,228 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,279 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,279 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,330 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,330 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,357 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311125064ae8f99624a9596e637bd55d40547 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311125064ae8f99624a9596e637bd55d40547 2023-11-12 00:54:59,358 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testGetAfterCompaction' column='f1' 2023-11-12 00:54:59,371 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:54:59,372 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:54:59,379 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:54:59,381 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:54:59,382 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,382 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,392 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/f1/353e7d4fb0ec463e89e018cd2de7acda first=Optional[r1] last=Optional[r2] 2023-11-12 00:54:59,392 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{f1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/f1/353e7d4fb0ec463e89e018cd2de7acda}] 2023-11-12 00:54:59,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/f1/353e7d4fb0ec463e89e018cd2de7acda for inclusion in 4a18401752b50e23a68b0f93c34cf917/f1 2023-11-12 00:54:59,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-12 00:54:59,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:54:59,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:54:59,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/f1/353e7d4fb0ec463e89e018cd2de7acda to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testGetAfterCompaction__cnt8fvj071q5ac5sclfj2j1gvtsrvqbmeqfut9qjmnr2q74kgc313tt1hcvo2hfv/f1/353e7d4fb0ec463e89e018cd2de7acda 2023-11-12 00:54:59,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testGetAfterCompaction__cnt8fvj071q5ac5sclfj2j1gvtsrvqbmeqfut9qjmnr2q74kgc313tt1hcvo2hfv/f1/353e7d4fb0ec463e89e018cd2de7acda as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_ 2023-11-12 00:54:59,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testGetAfterCompaction__cnt8fvj071q5ac5sclfj2j1gvtsrvqbmeqfut9qjmnr2q74kgc313tt1hcvo2hfv/f1/353e7d4fb0ec463e89e018cd2de7acda into 4a18401752b50e23a68b0f93c34cf917/f1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_ - updating store file list. 2023-11-12 00:54:59,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_ into 4a18401752b50e23a68b0f93c34cf917/f1 2023-11-12 00:54:59,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testGetAfterCompaction__cnt8fvj071q5ac5sclfj2j1gvtsrvqbmeqfut9qjmnr2q74kgc313tt1hcvo2hfv/f1/353e7d4fb0ec463e89e018cd2de7acda into 4a18401752b50e23a68b0f93c34cf917/f1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_) 2023-11-12 00:54:59,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testGetAfterCompaction__cnt8fvj071q5ac5sclfj2j1gvtsrvqbmeqfut9qjmnr2q74kgc313tt1hcvo2hfv/f1/353e7d4fb0ec463e89e018cd2de7acda 2023-11-12 00:54:59,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): 4a18401752b50e23a68b0f93c34cf917/f1 is initiating minor compaction 2023-11-12 00:54:59,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c7d8ae0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:54:59,407 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4a18401752b50e23a68b0f93c34cf917/f1 in testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:59,407 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/.tmp, totalSize=10.0 K 2023-11-12 00:54:59,407 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting e83e499a394449b0bba2f6e43126ffce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:54:59,407 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 28d1a65af94442bb9e151b5971c80532_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:54:59,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testGetAfterCompaction' column='f1' 2023-11-12 00:54:59,410 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:54:59,412 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231112056cf44fb9bf42ce9b4102111478e26c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231112056cf44fb9bf42ce9b4102111478e26c 2023-11-12 00:54:59,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311124516c650740d4e8ba416f6c9ac63c422 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311124516c650740d4e8ba416f6c9ac63c422 2023-11-12 00:54:59,414 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-12 00:54:59,414 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231112' 2023-11-12 00:54:59,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231112 for table='testGetAfterCompaction' and column='f1' 2023-11-12 00:54:59,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-12 00:54:59,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:54:59,415 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-12 00:54:59,415 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4a18401752b50e23a68b0f93c34cf917#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:54:59,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 898 msec 2023-11-12 00:54:59,432 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,432 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,433 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,436 DEBUG [Listener at localhost/40343] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-12 00:54:59,439 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-12 00:54:59,440 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43681] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:54:59,440 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-12 00:54:59,440 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-12 00:54:59,440 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43681] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-12 00:54:59,440 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43681] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. because compaction request was cancelled 2023-11-12 00:54:59,492 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,492 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,492 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,543 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,543 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,543 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,594 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,594 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,594 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,598 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-12 00:54:59,598 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-12 00:54:59,644 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,644 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,644 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,695 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,695 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,695 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,746 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,746 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,746 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,797 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,798 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,798 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,848 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,849 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,849 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,899 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,900 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,900 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,950 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:54:59,951 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:54:59,951 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,001 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,001 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:55:00,001 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,052 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,052 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:55:00,052 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,103 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,103 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:55:00,103 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,153 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,154 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:55:00,154 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,204 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,204 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699750499351; access_time=1699750498536; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-12 00:55:00,204 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750498506; access_time=1699750497678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,229 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/.tmp/f1/a2eb4c417b50434dbc7e987f3b574992 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/a2eb4c417b50434dbc7e987f3b574992 2023-11-12 00:55:00,233 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 4a18401752b50e23a68b0f93c34cf917/f1 of 4a18401752b50e23a68b0f93c34cf917 into a2eb4c417b50434dbc7e987f3b574992(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:00,233 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:55:00,233 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699750499407; duration=0sec 2023-11-12 00:55:00,233 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:00,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_] to archive 2023-11-12 00:55:00,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:00,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/e83e499a394449b0bba2f6e43126ffce 2023-11-12 00:55:00,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/28d1a65af94442bb9e151b5971c80532_SeqId_12_ 2023-11-12 00:55:00,255 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699750497662; access_time=1699750497244; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,255 INFO [Listener at localhost/40343] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/a2eb4c417b50434dbc7e987f3b574992; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699750500224; access_time=1699750499412; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-12 00:55:00,370 INFO [Listener at localhost/40343] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-12 00:55:00,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-12 00:55:00,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750500382"}]},"ts":"1699750500382"} 2023-11-12 00:55:00,384 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-12 00:55:00,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-12 00:55:00,386 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-12 00:55:00,388 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, UNASSIGN}] 2023-11-12 00:55:00,389 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, UNASSIGN 2023-11-12 00:55:00,389 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4a18401752b50e23a68b0f93c34cf917, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:00,389 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699750500389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750500389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750500389"}]},"ts":"1699750500389"} 2023-11-12 00:55:00,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 4a18401752b50e23a68b0f93c34cf917, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:00,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-12 00:55:00,542 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:00,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:55:00,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a18401752b50e23a68b0f93c34cf917, disabling compactions & flushes 2023-11-12 00:55:00,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:55:00,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:55:00,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. after waiting 0 ms 2023-11-12 00:55:00,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:55:00,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-12 00:55:00,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-12 00:55:00,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917. 2023-11-12 00:55:00,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a18401752b50e23a68b0f93c34cf917: 2023-11-12 00:55:00,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:55:00,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4a18401752b50e23a68b0f93c34cf917, regionState=CLOSED 2023-11-12 00:55:00,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699750500550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750500550"}]},"ts":"1699750500550"} 2023-11-12 00:55:00,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-12 00:55:00,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 4a18401752b50e23a68b0f93c34cf917, server=jenkins-hbase4.apache.org,43681,1699750400629 in 160 msec 2023-11-12 00:55:00,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-12 00:55:00,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=4a18401752b50e23a68b0f93c34cf917, UNASSIGN in 166 msec 2023-11-12 00:55:00,554 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750500554"}]},"ts":"1699750500554"} 2023-11-12 00:55:00,555 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-12 00:55:00,556 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-12 00:55:00,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 181 msec 2023-11-12 00:55:00,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-12 00:55:00,686 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-12 00:55:00,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-12 00:55:00,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,697 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,699 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-12 00:55:00,702 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:55:00,704 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1, FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/recovered.edits] 2023-11-12 00:55:00,707 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/20a55597d4524ab688e5bd1ce638e2e3 2023-11-12 00:55:00,709 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/a2eb4c417b50434dbc7e987f3b574992 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/f1/a2eb4c417b50434dbc7e987f3b574992 2023-11-12 00:55:00,712 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/recovered.edits/15.seqid to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917/recovered.edits/15.seqid 2023-11-12 00:55:00,712 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testGetAfterCompaction/4a18401752b50e23a68b0f93c34cf917 2023-11-12 00:55:00,712 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-12 00:55:00,713 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-12 00:55:00,714 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-12 00:55:00,717 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311125064ae8f99624a9596e637bd55d40547 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311125064ae8f99624a9596e637bd55d40547 2023-11-12 00:55:00,717 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-12 00:55:00,719 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,748 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-12 00:55:00,751 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-12 00:55:00,752 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,752 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-12 00:55:00,752 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699750500752"}]},"ts":"9223372036854775807"} 2023-11-12 00:55:00,753 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-12 00:55:00,753 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4a18401752b50e23a68b0f93c34cf917, NAME => 'testGetAfterCompaction,,1699750495071.4a18401752b50e23a68b0f93c34cf917.', STARTKEY => '', ENDKEY => ''}] 2023-11-12 00:55:00,753 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-12 00:55:00,754 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699750500753"}]},"ts":"9223372036854775807"} 2023-11-12 00:55:00,755 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-12 00:55:00,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-12 00:55:00,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 66 msec 2023-11-12 00:55:00,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-12 00:55:00,801 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-12 00:55:00,815 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 254), OpenFileDescriptor=625 (was 670), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=130 (was 124) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=820 (was 864) 2023-11-12 00:55:00,827 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=240, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=130, ProcessCount=171, AvailableMemoryMB=819 2023-11-12 00:55:00,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-12 00:55:00,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-12 00:55:00,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:55:00,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-12 00:55:00,832 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:55:00,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-12 00:55:00,834 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:00,834 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:00,834 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:00,835 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 empty. 2023-11-12 00:55:00,835 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b empty. 2023-11-12 00:55:00,835 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f empty. 2023-11-12 00:55:00,835 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:00,835 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:00,835 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:00,836 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-12 00:55:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-12 00:55:01,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-12 00:55:01,248 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-12 00:55:01,250 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 102e79e9eb9e2fd338dca31ed883a20f, NAME => 'testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:01,250 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 30776669ce9a16f9418734b4c50a772b, NAME => 'testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:01,250 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5f718172b15982a24b524747297f2bf3, NAME => 'testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:01,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 5f718172b15982a24b524747297f2bf3, disabling compactions & flushes 2023-11-12 00:55:01,662 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. after waiting 0 ms 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:01,662 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:01,662 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:01,663 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 30776669ce9a16f9418734b4c50a772b, disabling compactions & flushes 2023-11-12 00:55:01,663 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:01,663 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:01,663 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. after waiting 0 ms 2023-11-12 00:55:01,663 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:01,663 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:01,663 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:01,667 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:01,667 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 102e79e9eb9e2fd338dca31ed883a20f, disabling compactions & flushes 2023-11-12 00:55:01,667 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:01,667 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:01,667 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. after waiting 0 ms 2023-11-12 00:55:01,667 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:01,667 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:01,667 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:01,670 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:55:01,671 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750501670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750501670"}]},"ts":"1699750501670"} 2023-11-12 00:55:01,671 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750501670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750501670"}]},"ts":"1699750501670"} 2023-11-12 00:55:01,671 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750501670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750501670"}]},"ts":"1699750501670"} 2023-11-12 00:55:01,673 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-12 00:55:01,674 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:55:01,674 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750501674"}]},"ts":"1699750501674"} 2023-11-12 00:55:01,675 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-12 00:55:01,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN}] 2023-11-12 00:55:01,683 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN 2023-11-12 00:55:01,683 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN 2023-11-12 00:55:01,683 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN 2023-11-12 00:55:01,684 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:01,684 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:01,684 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:01,835 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=5f718172b15982a24b524747297f2bf3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:01,835 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=30776669ce9a16f9418734b4c50a772b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:01,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=102e79e9eb9e2fd338dca31ed883a20f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:01,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750501835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750501835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750501835"}]},"ts":"1699750501835"} 2023-11-12 00:55:01,836 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750501835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750501835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750501835"}]},"ts":"1699750501835"} 2023-11-12 00:55:01,836 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750501835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750501835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750501835"}]},"ts":"1699750501835"} 2023-11-12 00:55:01,837 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 30776669ce9a16f9418734b4c50a772b, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:01,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 5f718172b15982a24b524747297f2bf3, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:01,840 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 102e79e9eb9e2fd338dca31ed883a20f, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:01,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-12 00:55:01,990 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:01,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:01,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 102e79e9eb9e2fd338dca31ed883a20f, NAME => 'testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.', STARTKEY => '2', ENDKEY => ''} 2023-11-12 00:55:01,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:01,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:01,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:01,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:01,995 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:01,996 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:01,996 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:01,996 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 102e79e9eb9e2fd338dca31ed883a20f columnFamilyName family1 2023-11-12 00:55:01,997 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(310): Store=102e79e9eb9e2fd338dca31ed883a20f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:01,997 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:01,998 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2 2023-11-12 00:55:01,998 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2 2023-11-12 00:55:01,999 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 102e79e9eb9e2fd338dca31ed883a20f columnFamilyName family2 2023-11-12 00:55:02,000 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(310): Store=102e79e9eb9e2fd338dca31ed883a20f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:02,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:02,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:02,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:02,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:02,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:02,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 102e79e9eb9e2fd338dca31ed883a20f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64321810, jitterRate=-0.041530340909957886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:02,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:02,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f., pid=85, masterSystemTime=1699750501990 2023-11-12 00:55:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:02,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:02,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30776669ce9a16f9418734b4c50a772b, NAME => 'testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.', STARTKEY => '1', ENDKEY => '2'} 2023-11-12 00:55:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:02,007 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=102e79e9eb9e2fd338dca31ed883a20f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,008 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750502007"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750502007"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750502007"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750502007"}]},"ts":"1699750502007"} 2023-11-12 00:55:02,009 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,010 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:02,010 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:02,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=82 2023-11-12 00:55:02,010 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30776669ce9a16f9418734b4c50a772b columnFamilyName family1 2023-11-12 00:55:02,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 102e79e9eb9e2fd338dca31ed883a20f, server=jenkins-hbase4.apache.org,43681,1699750400629 in 171 msec 2023-11-12 00:55:02,011 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(310): Store=30776669ce9a16f9418734b4c50a772b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:02,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN in 329 msec 2023-11-12 00:55:02,011 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,013 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2 2023-11-12 00:55:02,013 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2 2023-11-12 00:55:02,013 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30776669ce9a16f9418734b4c50a772b columnFamilyName family2 2023-11-12 00:55:02,013 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(310): Store=30776669ce9a16f9418734b4c50a772b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:02,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:02,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:02,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:02,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30776669ce9a16f9418734b4c50a772b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63388047, jitterRate=-0.055444493889808655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:02,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:02,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b., pid=83, masterSystemTime=1699750501990 2023-11-12 00:55:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:02,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:02,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f718172b15982a24b524747297f2bf3, NAME => 'testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.', STARTKEY => '', ENDKEY => '1'} 2023-11-12 00:55:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=30776669ce9a16f9418734b4c50a772b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750502020"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750502020"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750502020"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750502020"}]},"ts":"1699750502020"} 2023-11-12 00:55:02,021 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,022 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:02,022 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:02,022 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f718172b15982a24b524747297f2bf3 columnFamilyName family1 2023-11-12 00:55:02,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=81 2023-11-12 00:55:02,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 30776669ce9a16f9418734b4c50a772b, server=jenkins-hbase4.apache.org,43681,1699750400629 in 184 msec 2023-11-12 00:55:02,023 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(310): Store=5f718172b15982a24b524747297f2bf3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:02,023 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN in 344 msec 2023-11-12 00:55:02,024 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2 2023-11-12 00:55:02,024 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2 2023-11-12 00:55:02,025 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f718172b15982a24b524747297f2bf3 columnFamilyName family2 2023-11-12 00:55:02,025 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(310): Store=5f718172b15982a24b524747297f2bf3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:02,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:02,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:02,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f718172b15982a24b524747297f2bf3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75183923, jitterRate=0.12032775580883026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:02,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:02,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3., pid=84, masterSystemTime=1699750501990 2023-11-12 00:55:02,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:02,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:02,032 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=5f718172b15982a24b524747297f2bf3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:02,032 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750502032"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750502032"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750502032"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750502032"}]},"ts":"1699750502032"} 2023-11-12 00:55:02,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=80 2023-11-12 00:55:02,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 5f718172b15982a24b524747297f2bf3, server=jenkins-hbase4.apache.org,43681,1699750400629 in 195 msec 2023-11-12 00:55:02,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=80, resume processing ppid=79 2023-11-12 00:55:02,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN in 355 msec 2023-11-12 00:55:02,036 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:55:02,036 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750502036"}]},"ts":"1699750502036"} 2023-11-12 00:55:02,037 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-12 00:55:02,040 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:55:02,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2110 sec 2023-11-12 00:55:02,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-12 00:55:02,937 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-12 00:55:02,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:02,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:02,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:02,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:02,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-12 00:55:02,950 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-12 00:55:02,950 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:02,950 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-12 00:55:02,950 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-12 00:55:02,950 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:02,950 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:02,951 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:02,951 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:02,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:02,952 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:02,952 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:02,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:02,953 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-12 00:55:02,953 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-12 00:55:02,953 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-12 00:55:02,953 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:02,953 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-12 00:55:02,953 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:02,953 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. started... 2023-11-12 00:55:02,955 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 30776669ce9a16f9418734b4c50a772b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:02,955 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:02,955 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. started... 2023-11-12 00:55:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:02,956 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 102e79e9eb9e2fd338dca31ed883a20f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:02,956 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:02,956 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:02,956 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. started... 2023-11-12 00:55:02,956 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5f718172b15982a24b524747297f2bf3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:03,370 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c 2023-11-12 00:55:03,370 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 2023-11-12 00:55:03,385 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 2023-11-12 00:55:03,388 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/26469a7002c24fd3892c318f1423b6b2 2023-11-12 00:55:03,388 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/31b5d21274c548739ca9685789215539 2023-11-12 00:55:03,409 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112686bac2bb57042ec9785fe59aee6be97 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112686bac2bb57042ec9785fe59aee6be97 2023-11-12 00:55:03,797 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/fef1611765f04a04b70c752a8ae1d605 2023-11-12 00:55:03,812 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112dbd6dd5f5bf1476781c71cd62072fdec to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112dbd6dd5f5bf1476781c71cd62072fdec 2023-11-12 00:55:03,817 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/8d8ed76f1c7d449b9a50e0064607d8f9 2023-11-12 00:55:03,823 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/31b5d21274c548739ca9685789215539 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539 2023-11-12 00:55:03,828 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539, entries=4, sequenceid=5, filesize=5.4 K 2023-11-12 00:55:03,829 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/8d8ed76f1c7d449b9a50e0064607d8f9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9 2023-11-12 00:55:03,835 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:03,836 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5f718172b15982a24b524747297f2bf3 in 880ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:03,836 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-12 00:55:03,837 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:03,837 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:03,837 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:03,855 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/5113b5ffb2334955be6dfb67e90ef4db 2023-11-12 00:55:03,861 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/26469a7002c24fd3892c318f1423b6b2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2 2023-11-12 00:55:03,867 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2, entries=4, sequenceid=5, filesize=5.4 K 2023-11-12 00:55:03,868 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/5113b5ffb2334955be6dfb67e90ef4db as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db 2023-11-12 00:55:03,873 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:03,874 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 30776669ce9a16f9418734b4c50a772b in 918ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:03,874 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:03,874 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:03,875 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:04,216 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111262ff3b78f7c24851a837073c76773e6f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111262ff3b78f7c24851a837073c76773e6f 2023-11-12 00:55:04,621 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/c529a375558f4c678ce4be07f1c9471f 2023-11-12 00:55:04,626 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/fef1611765f04a04b70c752a8ae1d605 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605 2023-11-12 00:55:04,630 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605, entries=4, sequenceid=5, filesize=5.4 K 2023-11-12 00:55:04,631 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/c529a375558f4c678ce4be07f1c9471f as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f 2023-11-12 00:55:04,635 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:04,636 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 102e79e9eb9e2fd338dca31ed883a20f in 1680ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:04,636 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:04,636 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:04,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:04,636 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:04,637 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,637 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-12 00:55:04,637 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-12 00:55:04,641 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,641 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:04,642 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,642 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:04,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:04,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-12 00:55:04,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a491f9f[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:04,644 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-12 00:55:04,644 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,645 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-12 00:55:04,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-12 00:55:04,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:04,645 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,645 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:04,647 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-12 00:55:04,647 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,647 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:04,647 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-12 00:55:04,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:04,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:04,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:04,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-12 00:55:04,649 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-12 00:55:04,650 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:04,650 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:04,650 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-12 00:55:04,650 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:04,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:04,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,653 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:04,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:04,653 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:04,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:04,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:04,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,654 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:04,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,656 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,656 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:04,656 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:04,656 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:04,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:04,656 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:04,657 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,657 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-12 00:55:04,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-12 00:55:04,657 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:04,657 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,657 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:04,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:04,657 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:04,657 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:04,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:04,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:04,757 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:04,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:04,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:04,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:04,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:04,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:04,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:04,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-12 00:55:04,763 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-12 00:55:04,763 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:04,763 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-12 00:55:04,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-12 00:55:04,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:04,765 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,765 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:04,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:04,765 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:04,765 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:04,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:04,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:04,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:04,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:04,766 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-12 00:55:04,767 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-12 00:55:04,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-12 00:55:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-12 00:55:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-12 00:55:04,767 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:04,767 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. started... 2023-11-12 00:55:04,767 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:04,767 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 30776669ce9a16f9418734b4c50a772b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:04,767 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:04,768 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:04,767 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:04,768 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. started... 2023-11-12 00:55:04,767 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. started... 2023-11-12 00:55:04,768 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5f718172b15982a24b524747297f2bf3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:04,768 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 102e79e9eb9e2fd338dca31ed883a20f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:04,806 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 2023-11-12 00:55:04,810 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/c8eb87f8ec604c06b63fd0971e801be7 2023-11-12 00:55:05,191 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc 2023-11-12 00:55:05,203 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/4fd01fa062a74a8ea6b837cf616cd82b 2023-11-12 00:55:05,205 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 2023-11-12 00:55:05,211 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/a9a8acbbce0a45a39537c3e49b2d1b95 2023-11-12 00:55:05,222 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311127ce9f73d75ba4c61bc020af6ab31a59c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311127ce9f73d75ba4c61bc020af6ab31a59c 2023-11-12 00:55:05,225 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311128bca0876ac8e4626a90fde33f7fbdf9c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311128bca0876ac8e4626a90fde33f7fbdf9c 2023-11-12 00:55:05,233 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/91f30e370a0a40d5a89f897a57239cca 2023-11-12 00:55:05,233 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/2e50f32e1b2d4f639da3ea2cd42bc489 2023-11-12 00:55:05,238 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112118447953fec4ba381f93178056647b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112118447953fec4ba381f93178056647b2 2023-11-12 00:55:05,239 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/c8eb87f8ec604c06b63fd0971e801be7 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7 2023-11-12 00:55:05,240 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/4fd01fa062a74a8ea6b837cf616cd82b as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b 2023-11-12 00:55:05,245 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b, entries=4, sequenceid=9, filesize=5.4 K 2023-11-12 00:55:05,245 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/248a303fdbd944b7824fe022c70905dd 2023-11-12 00:55:05,245 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7, entries=4, sequenceid=9, filesize=5.4 K 2023-11-12 00:55:05,246 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/91f30e370a0a40d5a89f897a57239cca as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca 2023-11-12 00:55:05,246 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/2e50f32e1b2d4f639da3ea2cd42bc489 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489 2023-11-12 00:55:05,251 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/a9a8acbbce0a45a39537c3e49b2d1b95 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95 2023-11-12 00:55:05,252 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:05,252 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 102e79e9eb9e2fd338dca31ed883a20f in 484ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:05,253 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:05,253 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:05,253 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:05,253 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:05,253 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5f718172b15982a24b524747297f2bf3 in 485ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:05,254 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:05,254 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:05,254 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:05,257 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95, entries=4, sequenceid=9, filesize=5.4 K 2023-11-12 00:55:05,257 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/248a303fdbd944b7824fe022c70905dd as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd 2023-11-12 00:55:05,262 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:05,263 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 30776669ce9a16f9418734b4c50a772b in 496ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:05,263 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:05,263 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-12 00:55:05,263 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-12 00:55:05,273 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,273 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:05,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:05,273 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,274 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:05,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:05,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-12 00:55:05,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@583f2718[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:05,275 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-12 00:55:05,275 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,279 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-12 00:55:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-12 00:55:05,280 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:05,280 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,280 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-12 00:55:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:05,281 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-12 00:55:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:05,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:05,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:05,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:05,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-12 00:55:05,283 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-12 00:55:05,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:05,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:05,284 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-12 00:55:05,284 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:05,285 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,285 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:05,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,285 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:05,286 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:05,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:05,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,287 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:05,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:05,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:05,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:05,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:05,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-12 00:55:05,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:05,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-12 00:55:05,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:05,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:05,289 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:05,289 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,290 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:05,290 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:05,290 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:05,290 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:05,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:05,290 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,390 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:05,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:05,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:05,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:05,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:05,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:05,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-12 00:55:05,398 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-12 00:55:05,398 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:05,398 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-12 00:55:05,398 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-12 00:55:05,399 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,399 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:05,401 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,401 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:05,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:05,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:05,401 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:05,401 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:05,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:05,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-12 00:55:05,402 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-12 00:55:05,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-12 00:55:05,403 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-12 00:55:05,403 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:05,403 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-12 00:55:05,403 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:05,403 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:05,403 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:05,403 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. started... 2023-11-12 00:55:05,403 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:05,403 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. started... 2023-11-12 00:55:05,403 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:05,403 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 30776669ce9a16f9418734b4c50a772b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:05,403 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. started... 2023-11-12 00:55:05,403 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5f718172b15982a24b524747297f2bf3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:05,403 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 102e79e9eb9e2fd338dca31ed883a20f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:05,416 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 2023-11-12 00:55:05,420 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/eb55b08266c74d889c8d132e4cae2bb2 2023-11-12 00:55:05,441 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112beb254e80d824082a7714d1448706bcd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112beb254e80d824082a7714d1448706bcd 2023-11-12 00:55:05,461 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/1b168663b90841d68a76d0dadf5ec19a 2023-11-12 00:55:05,466 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/eb55b08266c74d889c8d132e4cae2bb2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2 2023-11-12 00:55:05,469 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-12 00:55:05,470 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/1b168663b90841d68a76d0dadf5ec19a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a 2023-11-12 00:55:05,473 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:05,474 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5f718172b15982a24b524747297f2bf3 in 71ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:05,474 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:05,474 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:05,474 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:05,818 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 2023-11-12 00:55:05,818 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 2023-11-12 00:55:06,049 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:55:06,224 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/453ce9c2bb9846c58663b45e4fa325d5 2023-11-12 00:55:06,224 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/1400c34bf4f64bed89b13790495daae1 2023-11-12 00:55:06,247 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111200ac3d4447ea4bc3878801106c1bb8b5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111200ac3d4447ea4bc3878801106c1bb8b5 2023-11-12 00:55:06,251 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/f26ae267ec3846a9a8676435cabb0b77 2023-11-12 00:55:06,255 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/1400c34bf4f64bed89b13790495daae1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1 2023-11-12 00:55:06,258 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1, entries=4, sequenceid=13, filesize=5.4 K 2023-11-12 00:55:06,259 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/f26ae267ec3846a9a8676435cabb0b77 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77 2023-11-12 00:55:06,262 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:06,263 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 30776669ce9a16f9418734b4c50a772b in 860ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:06,263 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:06,263 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:06,263 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:06,642 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311121eb1db6b919a4d2da18e7a72419b8a22 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311121eb1db6b919a4d2da18e7a72419b8a22 2023-11-12 00:55:07,047 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/91cce381f8b547fdbcd271d600847505 2023-11-12 00:55:07,051 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/453ce9c2bb9846c58663b45e4fa325d5 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5 2023-11-12 00:55:07,054 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5, entries=4, sequenceid=13, filesize=5.4 K 2023-11-12 00:55:07,055 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/91cce381f8b547fdbcd271d600847505 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505 2023-11-12 00:55:07,058 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:07,059 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 102e79e9eb9e2fd338dca31ed883a20f in 1656ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:07,059 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:07,059 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:07,059 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:07,059 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:07,059 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,059 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-12 00:55:07,059 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-12 00:55:07,061 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,061 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:07,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-12 00:55:07,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49716591[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:07,063 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-12 00:55:07,063 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,064 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-12 00:55:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-12 00:55:07,064 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:07,064 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,064 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:07,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-12 00:55:07,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:07,066 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,066 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-12 00:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:07,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:07,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-12 00:55:07,068 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-12 00:55:07,068 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:07,068 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:07,068 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-12 00:55:07,068 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:07,071 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,071 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,071 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:07,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:07,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:07,071 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:07,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:07,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,072 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:07,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:07,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:07,075 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:07,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:07,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-12 00:55:07,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:07,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,076 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:07,076 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:07,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:07,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:07,176 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:07,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:07,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:07,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:07,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:07,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:07,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:07,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-12 00:55:07,182 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-12 00:55:07,182 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:07,182 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-12 00:55:07,182 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-12 00:55:07,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,183 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:07,184 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:07,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:07,184 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:07,185 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:07,185 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:07,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:07,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-12 00:55:07,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-12 00:55:07,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-12 00:55:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-12 00:55:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-12 00:55:07,186 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:07,186 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. started... 2023-11-12 00:55:07,186 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:07,186 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. started... 2023-11-12 00:55:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:07,186 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 30776669ce9a16f9418734b4c50a772b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:07,186 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:07,186 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 102e79e9eb9e2fd338dca31ed883a20f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:07,187 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. started... 2023-11-12 00:55:07,187 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5f718172b15982a24b524747297f2bf3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:07,212 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb 2023-11-12 00:55:07,213 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c 2023-11-12 00:55:07,222 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/a089a6fd33734e2eaf7fb36e80c2a75a 2023-11-12 00:55:07,610 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 2023-11-12 00:55:07,621 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/1346f658d44f4de392b9a20ba9b1aff9 2023-11-12 00:55:07,635 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111266ba76024d1341658a3ef386b5bdf7d9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111266ba76024d1341658a3ef386b5bdf7d9 2023-11-12 00:55:08,015 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/265c665fce0e4965ade65a20468a1bfc 2023-11-12 00:55:08,032 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311127d0db20bd6004a1199f58944724d3ff5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311127d0db20bd6004a1199f58944724d3ff5 2023-11-12 00:55:08,039 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/ada3a60ad9424c099c512d74a686053a 2023-11-12 00:55:08,043 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/a089a6fd33734e2eaf7fb36e80c2a75a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a 2023-11-12 00:55:08,046 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a, entries=4, sequenceid=17, filesize=5.4 K 2023-11-12 00:55:08,047 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/ada3a60ad9424c099c512d74a686053a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a 2023-11-12 00:55:08,050 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:55:08,051 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 102e79e9eb9e2fd338dca31ed883a20f in 865ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:08,051 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:08,051 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:08,051 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:08,430 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111225a1716c1136439fabd37bb0d0401bd2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111225a1716c1136439fabd37bb0d0401bd2 2023-11-12 00:55:08,435 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/7a711cfaf51640fa8e9c47039b6399aa 2023-11-12 00:55:08,436 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/4104d0a9f25544b1b8a24e0ae6728474 2023-11-12 00:55:08,441 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/265c665fce0e4965ade65a20468a1bfc as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc 2023-11-12 00:55:08,442 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/1346f658d44f4de392b9a20ba9b1aff9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9 2023-11-12 00:55:08,446 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9, entries=4, sequenceid=17, filesize=5.4 K 2023-11-12 00:55:08,446 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc, entries=4, sequenceid=17, filesize=5.4 K 2023-11-12 00:55:08,446 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/4104d0a9f25544b1b8a24e0ae6728474 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474 2023-11-12 00:55:08,447 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/7a711cfaf51640fa8e9c47039b6399aa as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa 2023-11-12 00:55:08,461 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:55:08,462 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:55:08,462 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5f718172b15982a24b524747297f2bf3 in 1275ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:08,462 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 30776669ce9a16f9418734b4c50a772b in 1276ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:08,462 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:08,462 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:08,462 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:08,463 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:08,463 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:08,463 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:08,463 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:08,463 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,463 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-12 00:55:08,463 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-12 00:55:08,465 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,465 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:08,465 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,465 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:08,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:08,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-12 00:55:08,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1a56ff[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:08,467 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-12 00:55:08,467 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,470 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,470 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-12 00:55:08,470 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-12 00:55:08,470 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:08,470 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,470 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:08,472 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-12 00:55:08,472 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,472 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:08,472 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-12 00:55:08,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:08,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:08,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:08,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:08,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:08,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:08,475 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-12 00:55:08,475 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:08,475 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:08,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-12 00:55:08,475 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-12 00:55:08,475 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:08,477 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,477 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:08,477 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:08,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:08,478 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:08,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:08,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:08,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,480 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:08,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:08,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:08,487 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:08,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:08,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-12 00:55:08,488 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:08,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-12 00:55:08,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:08,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:08,489 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:08,489 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:08,589 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:08,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:08,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:08,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699750508604 (current time:1699750508604). 2023-11-12 00:55:08,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-12 00:55:08,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] zookeeper.ReadOnlyZKClient(139): Connect 0x72b14ad4 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:55:08,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e8453e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:55:08,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:55:08,623 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:55:08,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72b14ad4 to 127.0.0.1:60532 2023-11-12 00:55:08,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:08,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-12 00:55:08,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:08,636 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot, current working dir path: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/snaptb-1699750508590 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-12 00:55:08,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-12 00:55:08,645 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-12 00:55:08,646 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699751108646 2023-11-12 00:55:08,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:08,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699750508590 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-12 00:55:08,647 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-12 00:55:08,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-12 00:55:08,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-12 00:55:08,649 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-12 00:55:08,650 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699751108649 2023-11-12 00:55:08,651 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:08,651 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-12 00:55:08,752 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:08,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:08,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:08,755 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-12 00:55:08,956 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:08,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:08,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:08,956 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-12 00:55:09,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699750508590 2023-11-12 00:55:09,059 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699750508590' 2023-11-12 00:55:09,059 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-12 00:55:09,059 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699750508590' starting 'acquire' 2023-11-12 00:55:09,059 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699750508590', kicking off acquire phase on members. 2023-11-12 00:55:09,060 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,060 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699750508590 2023-11-12 00:55:09,062 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,062 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-12 00:55:09,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-12 00:55:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-12 00:55:09,062 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,062 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699750508590 2023-11-12 00:55:09,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-12 00:55:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699750508590 2023-11-12 00:55:09,064 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699750508590 from table testCompactionWithHFileLink type FLUSH 2023-11-12 00:55:09,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699750508590 2023-11-12 00:55:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699750508590' with timeout 300000ms 2023-11-12 00:55:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-12 00:55:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699750508590' starting 'acquire' stage 2023-11-12 00:55:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699750508590' locally acquired 2023-11-12 00:55:09,067 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (snaptb-1699750508590) in zk 2023-11-12 00:55:09,069 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-12 00:55:09,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699750508590' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:09,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:09,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699750508590 2023-11-12 00:55:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:09,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'snaptb-1699750508590' on coordinator 2023-11-12 00:55:09,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cbd0944[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:09,073 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699750508590' starting 'in-barrier' execution. 2023-11-12 00:55:09,073 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,075 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,076 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699750508590' received 'reached' from coordinator. 2023-11-12 00:55:09,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,076 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:09,078 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:09,078 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:09,079 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. started... 2023-11-12 00:55:09,079 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:09,080 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.' region-info for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,081 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. started... 2023-11-12 00:55:09,081 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:09,081 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.' region-info for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,085 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-12 00:55:09,085 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:09,085 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-12 00:55:09,085 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. started... 2023-11-12 00:55:09,085 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:09,085 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.' region-info for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,086 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-12 00:55:09,086 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-12 00:55:09,086 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-12 00:55:09,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a] hfiles 2023-11-12 00:55:09,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc] hfiles 2023-11-12 00:55:09,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9] hfiles 2023-11-12 00:55:09,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474] hfiles 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa] hfiles 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a] hfiles 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,094 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474 for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,106 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. completed. 2023-11-12 00:55:09,106 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-12 00:55:09,106 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. completed. 2023-11-12 00:55:09,106 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-12 00:55:09,257 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:09,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:09,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:09,257 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-12 00:55:09,504 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. completed. 2023-11-12 00:55:09,504 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-12 00:55:09,504 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-12 00:55:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699750508590' locally completed 2023-11-12 00:55:09,505 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699750508590' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:09,507 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699750508590' has notified controller of completion 2023-11-12 00:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-12 00:55:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:09,507 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699750508590' completed. 2023-11-12 00:55:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699750508590 2023-11-12 00:55:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699750508590 2023-11-12 00:55:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699750508590' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:09,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'snaptb-1699750508590', counting down latch. Waiting for 0 more 2023-11-12 00:55:09,510 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699750508590' execution completed 2023-11-12 00:55:09,510 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:09,510 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:09,510 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699750508590 2023-11-12 00:55:09,510 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699750508590including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-12 00:55:09,512 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,512 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-12 00:55:09,512 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-12 00:55:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:09,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-12 00:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-12 00:55:09,513 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699750508590 2023-11-12 00:55:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699750508590 2023-11-12 00:55:09,514 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699750508590 2023-11-12 00:55:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699750508590 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699750508590 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699750508590/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699750508590 2023-11-12 00:55:09,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-12 00:55:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-12 00:55:09,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-12 00:55:09,518 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699750508590 2023-11-12 00:55:09,518 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:09,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699750508590 2023-11-12 00:55:09,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-12 00:55:09,519 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699750508590 2023-11-12 00:55:09,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-12 00:55:09,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617] mob files 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 2023-11-12 00:55:09,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111200ac3d4447ea4bc3878801106c1bb8b5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112118447953fec4ba381f93178056647b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311127d0db20bd6004a1199f58944724d3ff5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112dbd6dd5f5bf1476781c71cd62072fdec, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311121eb1db6b919a4d2da18e7a72419b8a22, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111262ff3b78f7c24851a837073c76773e6f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111266ba76024d1341658a3ef386b5bdf7d9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311128bca0876ac8e4626a90fde33f7fbdf9c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111225a1716c1136439fabd37bb0d0401bd2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112686bac2bb57042ec9785fe59aee6be97, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311127ce9f73d75ba4c61bc020af6ab31a59c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112beb254e80d824082a7714d1448706bcd] mob files 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111200ac3d4447ea4bc3878801106c1bb8b5 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112118447953fec4ba381f93178056647b2 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311127d0db20bd6004a1199f58944724d3ff5 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112dbd6dd5f5bf1476781c71cd62072fdec 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311121eb1db6b919a4d2da18e7a72419b8a22 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111262ff3b78f7c24851a837073c76773e6f 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111266ba76024d1341658a3ef386b5bdf7d9 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311128bca0876ac8e4626a90fde33f7fbdf9c 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111225a1716c1136439fabd37bb0d0401bd2 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112686bac2bb57042ec9785fe59aee6be97 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311127ce9f73d75ba4c61bc020af6ab31a59c 2023-11-12 00:55:09,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112beb254e80d824082a7714d1448706bcd 2023-11-12 00:55:09,598 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-12 00:55:09,758 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:09,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:09,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:09,759 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-12 00:55:09,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699750508590 2023-11-12 00:55:09,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/snaptb-1699750508590 2023-11-12 00:55:09,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/snaptb-1699750508590 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/snaptb-1699750508590 2023-11-12 00:55:09,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699750508590 of table testCompactionWithHFileLink completed 2023-11-12 00:55:09,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/snaptb-1699750508590 2023-11-12 00:55:09,976 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/snaptb-1699750508590 2023-11-12 00:55:09,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699750508590 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699750508646Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699750509929 (+1283 ms)Consolidate snapshot: snaptb-1699750508590 at 1699750509929Loading Region manifests for snaptb-1699750508590 at 1699750509929Writing data manifest for snaptb-1699750508590 at 1699750509940 (+11 ms)Verifying snapshot: snaptb-1699750508590 at 1699750509948 (+8 ms)Snapshot snaptb-1699750508590 of table testCompactionWithHFileLink completed at 1699750509976 (+28 ms) 2023-11-12 00:55:09,978 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-12 00:55:09,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3310 sec 2023-11-12 00:55:10,759 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:10,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:10,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-12 00:55:10,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:10,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:10,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-12 00:55:10,790 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-12 00:55:10,790 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:10,790 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-12 00:55:10,790 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-12 00:55:10,790 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:10,790 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:10,792 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:10,792 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:10,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:10,792 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:10,792 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:10,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:10,793 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-12 00:55:10,793 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-12 00:55:10,793 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-12 00:55:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-12 00:55:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-12 00:55:10,794 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:10,794 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:10,794 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:10,794 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. started... 2023-11-12 00:55:10,794 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. started... 2023-11-12 00:55:10,794 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. started... 2023-11-12 00:55:10,794 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 30776669ce9a16f9418734b4c50a772b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:55:10,794 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5f718172b15982a24b524747297f2bf3 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:55:10,794 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 102e79e9eb9e2fd338dca31ed883a20f 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:55:10,810 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/6f2c16467e094671bad585c2f918b3d4 2023-11-12 00:55:10,815 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f2c16467e094671bad585c2f918b3d4 2023-11-12 00:55:11,228 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/a59e2c64c0bd4db4ae46da0d37518320 2023-11-12 00:55:11,231 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a59e2c64c0bd4db4ae46da0d37518320 2023-11-12 00:55:11,231 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/6f2c16467e094671bad585c2f918b3d4 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/6f2c16467e094671bad585c2f918b3d4 2023-11-12 00:55:11,235 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f2c16467e094671bad585c2f918b3d4 2023-11-12 00:55:11,235 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/6f2c16467e094671bad585c2f918b3d4, entries=3, sequenceid=24, filesize=5.0 K 2023-11-12 00:55:11,235 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/a59e2c64c0bd4db4ae46da0d37518320 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/a59e2c64c0bd4db4ae46da0d37518320 2023-11-12 00:55:11,239 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a59e2c64c0bd4db4ae46da0d37518320 2023-11-12 00:55:11,239 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/a59e2c64c0bd4db4ae46da0d37518320, entries=1, sequenceid=24, filesize=5.0 K 2023-11-12 00:55:11,239 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 102e79e9eb9e2fd338dca31ed883a20f in 445ms, sequenceid=24, compaction requested=true 2023-11-12 00:55:11,239 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:11,239 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:11,240 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:11,608 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/96aff64ec38940cba6794a345712ddac 2023-11-12 00:55:11,608 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/7d4e5f35403b447ba8e8682256bb2a2d 2023-11-12 00:55:11,613 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d4e5f35403b447ba8e8682256bb2a2d 2023-11-12 00:55:11,613 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96aff64ec38940cba6794a345712ddac 2023-11-12 00:55:12,030 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/2617f9394ab84fe7a8cfa4411be624f7 2023-11-12 00:55:12,034 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2617f9394ab84fe7a8cfa4411be624f7 2023-11-12 00:55:12,035 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/96aff64ec38940cba6794a345712ddac as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/96aff64ec38940cba6794a345712ddac 2023-11-12 00:55:12,038 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96aff64ec38940cba6794a345712ddac 2023-11-12 00:55:12,038 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/96aff64ec38940cba6794a345712ddac, entries=3, sequenceid=24, filesize=5.0 K 2023-11-12 00:55:12,038 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/2617f9394ab84fe7a8cfa4411be624f7 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2617f9394ab84fe7a8cfa4411be624f7 2023-11-12 00:55:12,041 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2617f9394ab84fe7a8cfa4411be624f7 2023-11-12 00:55:12,041 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2617f9394ab84fe7a8cfa4411be624f7, entries=1, sequenceid=24, filesize=5.0 K 2023-11-12 00:55:12,042 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5f718172b15982a24b524747297f2bf3 in 1248ms, sequenceid=24, compaction requested=true 2023-11-12 00:55:12,042 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:12,042 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:12,042 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:12,432 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/37af647a978e4f7e89ff605b0b07b5fc 2023-11-12 00:55:12,436 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37af647a978e4f7e89ff605b0b07b5fc 2023-11-12 00:55:12,436 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/7d4e5f35403b447ba8e8682256bb2a2d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/7d4e5f35403b447ba8e8682256bb2a2d 2023-11-12 00:55:12,440 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d4e5f35403b447ba8e8682256bb2a2d 2023-11-12 00:55:12,440 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/7d4e5f35403b447ba8e8682256bb2a2d, entries=3, sequenceid=24, filesize=5.0 K 2023-11-12 00:55:12,441 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/37af647a978e4f7e89ff605b0b07b5fc as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/37af647a978e4f7e89ff605b0b07b5fc 2023-11-12 00:55:12,444 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37af647a978e4f7e89ff605b0b07b5fc 2023-11-12 00:55:12,444 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/37af647a978e4f7e89ff605b0b07b5fc, entries=1, sequenceid=24, filesize=5.0 K 2023-11-12 00:55:12,445 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 30776669ce9a16f9418734b4c50a772b in 1651ms, sequenceid=24, compaction requested=true 2023-11-12 00:55:12,446 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:12,446 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:12,446 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:12,446 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:12,446 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,446 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-12 00:55:12,446 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-12 00:55:12,448 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,448 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:12,448 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,448 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:12,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:12,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:12,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-12 00:55:12,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d1be62c[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:12,450 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-12 00:55:12,451 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,452 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-12 00:55:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-12 00:55:12,452 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:12,452 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,452 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:12,453 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-12 00:55:12,454 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:12,453 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,454 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-12 00:55:12,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:12,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:12,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:12,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:12,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:12,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:12,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:12,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:12,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-12 00:55:12,457 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-12 00:55:12,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:12,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:12,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-12 00:55:12,457 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:12,460 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,460 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:12,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:12,460 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:12,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:12,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:12,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:12,460 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:12,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:12,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:12,462 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:12,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-12 00:55:12,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-12 00:55:12,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:12,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:12,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-12 00:55:12,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:12,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:12,464 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-12 00:55:12,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-12 00:55:12,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:12,464 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:12,565 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:12,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:12,566 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:12,566 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 30776669ce9a16f9418734b4c50a772b/family1 is initiating major compaction (all files) 2023-11-12 00:55:12,566 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:12,566 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:12,566 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 30776669ce9a16f9418734b4c50a772b/family1 in testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:12,567 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/7d4e5f35403b447ba8e8682256bb2a2d] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp, totalSize=26.7 K 2023-11-12 00:55:12,567 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 26469a7002c24fd3892c318f1423b6b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502944 2023-11-12 00:55:12,568 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting a9a8acbbce0a45a39537c3e49b2d1b95, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:12,568 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 1400c34bf4f64bed89b13790495daae1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:12,569 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 1346f658d44f4de392b9a20ba9b1aff9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:12,569 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 7d4e5f35403b447ba8e8682256bb2a2d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-12 00:55:12,596 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 30776669ce9a16f9418734b4c50a772b#family1#compaction#108 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:12,612 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del 2023-11-12 00:55:12,612 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del 2023-11-12 00:55:13,031 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 577fe66a72cd4bc78c43beaa195dff6e 2023-11-12 00:55:13,032 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/577fe66a72cd4bc78c43beaa195dff6e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/577fe66a72cd4bc78c43beaa195dff6e 2023-11-12 00:55:13,036 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 577fe66a72cd4bc78c43beaa195dff6e 2023-11-12 00:55:13,037 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 30776669ce9a16f9418734b4c50a772b/family1 of 30776669ce9a16f9418734b4c50a772b into 577fe66a72cd4bc78c43beaa195dff6e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:13,037 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:13,038 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:13,038 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 30776669ce9a16f9418734b4c50a772b/family2 is initiating major compaction (all files) 2023-11-12 00:55:13,038 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:13,038 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:13,038 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 30776669ce9a16f9418734b4c50a772b/family2 in testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:13,038 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/37af647a978e4f7e89ff605b0b07b5fc] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp, totalSize=25.4 K 2023-11-12 00:55:13,038 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 5113b5ffb2334955be6dfb67e90ef4db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502944 2023-11-12 00:55:13,039 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 248a303fdbd944b7824fe022c70905dd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:13,039 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting f26ae267ec3846a9a8676435cabb0b77, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:13,040 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 4104d0a9f25544b1b8a24e0ae6728474, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:13,040 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 37af647a978e4f7e89ff605b0b07b5fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-12 00:55:13,052 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 30776669ce9a16f9418734b4c50a772b#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:13,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/7d4e5f35403b447ba8e8682256bb2a2d] to archive 2023-11-12 00:55:13,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:13,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/26469a7002c24fd3892c318f1423b6b2 2023-11-12 00:55:13,139 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/a9a8acbbce0a45a39537c3e49b2d1b95 2023-11-12 00:55:13,140 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1400c34bf4f64bed89b13790495daae1 2023-11-12 00:55:13,142 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/1346f658d44f4de392b9a20ba9b1aff9 2023-11-12 00:55:13,143 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/7d4e5f35403b447ba8e8682256bb2a2d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/7d4e5f35403b447ba8e8682256bb2a2d 2023-11-12 00:55:13,462 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del 2023-11-12 00:55:13,463 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del 2023-11-12 00:55:13,486 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a00d65e5609451888d5f38db0e95b27 2023-11-12 00:55:13,487 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/7a00d65e5609451888d5f38db0e95b27 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/7a00d65e5609451888d5f38db0e95b27 2023-11-12 00:55:13,491 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a00d65e5609451888d5f38db0e95b27 2023-11-12 00:55:13,492 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 30776669ce9a16f9418734b4c50a772b/family2 of 30776669ce9a16f9418734b4c50a772b into 7a00d65e5609451888d5f38db0e95b27(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:13,492 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:13,492 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:13,492 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 102e79e9eb9e2fd338dca31ed883a20f/family1 is initiating major compaction (all files) 2023-11-12 00:55:13,492 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:13,492 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:13,492 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 102e79e9eb9e2fd338dca31ed883a20f/family1 in testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:13,493 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/6f2c16467e094671bad585c2f918b3d4] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp, totalSize=26.7 K 2023-11-12 00:55:13,494 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting fef1611765f04a04b70c752a8ae1d605, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502945 2023-11-12 00:55:13,494 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting c8eb87f8ec604c06b63fd0971e801be7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:13,495 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 453ce9c2bb9846c58663b45e4fa325d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:13,495 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting a089a6fd33734e2eaf7fb36e80c2a75a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:13,495 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 6f2c16467e094671bad585c2f918b3d4, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-12 00:55:13,507 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 102e79e9eb9e2fd338dca31ed883a20f#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:13,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/37af647a978e4f7e89ff605b0b07b5fc] to archive 2023-11-12 00:55:13,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:13,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/5113b5ffb2334955be6dfb67e90ef4db 2023-11-12 00:55:13,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/248a303fdbd944b7824fe022c70905dd 2023-11-12 00:55:13,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/f26ae267ec3846a9a8676435cabb0b77 2023-11-12 00:55:13,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/4104d0a9f25544b1b8a24e0ae6728474 2023-11-12 00:55:13,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/37af647a978e4f7e89ff605b0b07b5fc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/37af647a978e4f7e89ff605b0b07b5fc 2023-11-12 00:55:13,925 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del 2023-11-12 00:55:13,925 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del 2023-11-12 00:55:13,942 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88ee3498ac00448fbc2f996f60a23f21 2023-11-12 00:55:13,942 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/88ee3498ac00448fbc2f996f60a23f21 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/88ee3498ac00448fbc2f996f60a23f21 2023-11-12 00:55:13,946 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88ee3498ac00448fbc2f996f60a23f21 2023-11-12 00:55:13,947 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 102e79e9eb9e2fd338dca31ed883a20f/family1 of 102e79e9eb9e2fd338dca31ed883a20f into 88ee3498ac00448fbc2f996f60a23f21(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:13,947 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:13,947 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:13,947 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 102e79e9eb9e2fd338dca31ed883a20f/family2 is initiating major compaction (all files) 2023-11-12 00:55:13,948 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:13,948 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:13,948 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 102e79e9eb9e2fd338dca31ed883a20f/family2 in testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:13,948 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/a59e2c64c0bd4db4ae46da0d37518320] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp, totalSize=25.4 K 2023-11-12 00:55:13,949 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting c529a375558f4c678ce4be07f1c9471f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502945 2023-11-12 00:55:13,949 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 2e50f32e1b2d4f639da3ea2cd42bc489, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:13,950 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 91cce381f8b547fdbcd271d600847505, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:13,950 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting ada3a60ad9424c099c512d74a686053a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:13,951 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting a59e2c64c0bd4db4ae46da0d37518320, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-12 00:55:13,976 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 102e79e9eb9e2fd338dca31ed883a20f#family2#compaction#111 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:13,990 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del 2023-11-12 00:55:13,990 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del 2023-11-12 00:55:14,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/6f2c16467e094671bad585c2f918b3d4] to archive 2023-11-12 00:55:14,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:14,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/fef1611765f04a04b70c752a8ae1d605 2023-11-12 00:55:14,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/c8eb87f8ec604c06b63fd0971e801be7 2023-11-12 00:55:14,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/453ce9c2bb9846c58663b45e4fa325d5 2023-11-12 00:55:14,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a089a6fd33734e2eaf7fb36e80c2a75a 2023-11-12 00:55:14,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/6f2c16467e094671bad585c2f918b3d4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/6f2c16467e094671bad585c2f918b3d4 2023-11-12 00:55:14,406 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff00c21442844ce0b5b0372f96b70fcd 2023-11-12 00:55:14,407 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/ff00c21442844ce0b5b0372f96b70fcd as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ff00c21442844ce0b5b0372f96b70fcd 2023-11-12 00:55:14,413 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff00c21442844ce0b5b0372f96b70fcd 2023-11-12 00:55:14,414 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 102e79e9eb9e2fd338dca31ed883a20f/family2 of 102e79e9eb9e2fd338dca31ed883a20f into ff00c21442844ce0b5b0372f96b70fcd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:14,414 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:14,414 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:14,415 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 5f718172b15982a24b524747297f2bf3/family1 is initiating major compaction (all files) 2023-11-12 00:55:14,415 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:14,415 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:14,415 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 5f718172b15982a24b524747297f2bf3/family1 in testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:14,415 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/96aff64ec38940cba6794a345712ddac] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp, totalSize=26.7 K 2023-11-12 00:55:14,417 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 31b5d21274c548739ca9685789215539, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502943 2023-11-12 00:55:14,418 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 4fd01fa062a74a8ea6b837cf616cd82b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:14,418 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting eb55b08266c74d889c8d132e4cae2bb2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:14,419 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 265c665fce0e4965ade65a20468a1bfc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:14,419 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 96aff64ec38940cba6794a345712ddac, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-12 00:55:14,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/a59e2c64c0bd4db4ae46da0d37518320] to archive 2023-11-12 00:55:14,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:14,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/c529a375558f4c678ce4be07f1c9471f 2023-11-12 00:55:14,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/2e50f32e1b2d4f639da3ea2cd42bc489 2023-11-12 00:55:14,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/91cce381f8b547fdbcd271d600847505 2023-11-12 00:55:14,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ada3a60ad9424c099c512d74a686053a 2023-11-12 00:55:14,439 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 5f718172b15982a24b524747297f2bf3#family1#compaction#112 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:14,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/a59e2c64c0bd4db4ae46da0d37518320 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/a59e2c64c0bd4db4ae46da0d37518320 2023-11-12 00:55:14,457 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del 2023-11-12 00:55:14,457 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del 2023-11-12 00:55:14,886 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b6fb2ff410c44609cc491e983a8bb5c 2023-11-12 00:55:14,887 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/7b6fb2ff410c44609cc491e983a8bb5c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/7b6fb2ff410c44609cc491e983a8bb5c 2023-11-12 00:55:14,896 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b6fb2ff410c44609cc491e983a8bb5c 2023-11-12 00:55:14,897 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5f718172b15982a24b524747297f2bf3/family1 of 5f718172b15982a24b524747297f2bf3 into 7b6fb2ff410c44609cc491e983a8bb5c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:14,898 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:14,898 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:14,898 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 5f718172b15982a24b524747297f2bf3/family2 is initiating major compaction (all files) 2023-11-12 00:55:14,898 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:14,898 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:14,898 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 5f718172b15982a24b524747297f2bf3/family2 in testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:14,898 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2617f9394ab84fe7a8cfa4411be624f7] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp, totalSize=25.4 K 2023-11-12 00:55:14,899 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 8d8ed76f1c7d449b9a50e0064607d8f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502943 2023-11-12 00:55:14,899 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 91f30e370a0a40d5a89f897a57239cca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:14,900 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 1b168663b90841d68a76d0dadf5ec19a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:14,900 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 7a711cfaf51640fa8e9c47039b6399aa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:14,901 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 2617f9394ab84fe7a8cfa4411be624f7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-12 00:55:14,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/96aff64ec38940cba6794a345712ddac] to archive 2023-11-12 00:55:14,929 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 5f718172b15982a24b524747297f2bf3#family2#compaction#113 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:14,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:14,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/31b5d21274c548739ca9685789215539 2023-11-12 00:55:14,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/4fd01fa062a74a8ea6b837cf616cd82b 2023-11-12 00:55:14,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/eb55b08266c74d889c8d132e4cae2bb2 2023-11-12 00:55:14,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/265c665fce0e4965ade65a20468a1bfc 2023-11-12 00:55:14,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/96aff64ec38940cba6794a345712ddac to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/96aff64ec38940cba6794a345712ddac 2023-11-12 00:55:14,941 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del 2023-11-12 00:55:14,941 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del 2023-11-12 00:55:15,100 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:55:15,759 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bf38d881dc84a72848b0f169330a3d1 2023-11-12 00:55:15,760 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/8bf38d881dc84a72848b0f169330a3d1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8bf38d881dc84a72848b0f169330a3d1 2023-11-12 00:55:15,764 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bf38d881dc84a72848b0f169330a3d1 2023-11-12 00:55:15,765 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5f718172b15982a24b524747297f2bf3/family2 of 5f718172b15982a24b524747297f2bf3 into 8bf38d881dc84a72848b0f169330a3d1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:15,765 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:15,770 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:15,774 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:15,779 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:15,780 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:15,787 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-12 00:55:15,821 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-12 00:55:15,824 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del 2023-11-12 00:55:15,827 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del 2023-11-12 00:55:15,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2617f9394ab84fe7a8cfa4411be624f7] to archive 2023-11-12 00:55:15,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:15,830 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del 2023-11-12 00:55:15,830 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:15,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8d8ed76f1c7d449b9a50e0064607d8f9 2023-11-12 00:55:15,831 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(139): Connect 0x6d419da6 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:55:15,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/91f30e370a0a40d5a89f897a57239cca 2023-11-12 00:55:15,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/1b168663b90841d68a76d0dadf5ec19a 2023-11-12 00:55:15,836 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38c82e51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:55:15,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/7a711cfaf51640fa8e9c47039b6399aa 2023-11-12 00:55:15,836 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:15,837 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:15,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2617f9394ab84fe7a8cfa4411be624f7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2617f9394ab84fe7a8cfa4411be624f7 2023-11-12 00:55:15,837 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:15,931 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111282e6b37b085c4b4a90c5ff1646a4042a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111282e6b37b085c4b4a90c5ff1646a4042a 2023-11-12 00:55:15,932 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:15,932 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112470a2df1535d4c6a92ecfc8f4dac42fb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112470a2df1535d4c6a92ecfc8f4dac42fb 2023-11-12 00:55:15,933 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:15,946 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:55:15,949 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:55:15,956 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:55:15,957 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:55:15,973 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/b070c6807cfa46f784622d835ea35c5d first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-12 00:55:15,973 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/37ca4aa3efcb48beaf89d031a3a2335b first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-12 00:55:15,975 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/b070c6807cfa46f784622d835ea35c5d}] 2023-11-12 00:55:15,975 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/37ca4aa3efcb48beaf89d031a3a2335b}] 2023-11-12 00:55:15,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/37ca4aa3efcb48beaf89d031a3a2335b for inclusion in 102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:15,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/b070c6807cfa46f784622d835ea35c5d for inclusion in 30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:15,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-12 00:55:15,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-12 00:55:15,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-12 00:55:15,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-12 00:55:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/b070c6807cfa46f784622d835ea35c5d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__vj9tb06mg2758rh6tud35idqsmaduktaji7gqcie0f69jg8qpr7irrejrcq9e76r/family1/b070c6807cfa46f784622d835ea35c5d 2023-11-12 00:55:15,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/37ca4aa3efcb48beaf89d031a3a2335b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__sbgqmebk87ph55a7tme5pc5lciunm7hkoo57a0bli9j69rsugismrmr1tag5j2h5/family1/37ca4aa3efcb48beaf89d031a3a2335b 2023-11-12 00:55:15,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__vj9tb06mg2758rh6tud35idqsmaduktaji7gqcie0f69jg8qpr7irrejrcq9e76r/family1/b070c6807cfa46f784622d835ea35c5d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_ 2023-11-12 00:55:15,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__sbgqmebk87ph55a7tme5pc5lciunm7hkoo57a0bli9j69rsugismrmr1tag5j2h5/family1/37ca4aa3efcb48beaf89d031a3a2335b as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_ 2023-11-12 00:55:15,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__vj9tb06mg2758rh6tud35idqsmaduktaji7gqcie0f69jg8qpr7irrejrcq9e76r/family1/b070c6807cfa46f784622d835ea35c5d into 30776669ce9a16f9418734b4c50a772b/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_ - updating store file list. 2023-11-12 00:55:15,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__sbgqmebk87ph55a7tme5pc5lciunm7hkoo57a0bli9j69rsugismrmr1tag5j2h5/family1/37ca4aa3efcb48beaf89d031a3a2335b into 102e79e9eb9e2fd338dca31ed883a20f/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_ - updating store file list. 2023-11-12 00:55:15,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_ into 102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:15,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__sbgqmebk87ph55a7tme5pc5lciunm7hkoo57a0bli9j69rsugismrmr1tag5j2h5/family1/37ca4aa3efcb48beaf89d031a3a2335b into 102e79e9eb9e2fd338dca31ed883a20f/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_) 2023-11-12 00:55:15,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_ into 30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:15,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__vj9tb06mg2758rh6tud35idqsmaduktaji7gqcie0f69jg8qpr7irrejrcq9e76r/family1/b070c6807cfa46f784622d835ea35c5d into 30776669ce9a16f9418734b4c50a772b/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_) 2023-11-12 00:55:15,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__sbgqmebk87ph55a7tme5pc5lciunm7hkoo57a0bli9j69rsugismrmr1tag5j2h5/family1/37ca4aa3efcb48beaf89d031a3a2335b 2023-11-12 00:55:15,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__vj9tb06mg2758rh6tud35idqsmaduktaji7gqcie0f69jg8qpr7irrejrcq9e76r/family1/b070c6807cfa46f784622d835ea35c5d 2023-11-12 00:55:15,995 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:15,995 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:15,996 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:15,996 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:15,997 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 2023-11-12 00:55:15,998 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb 2023-11-12 00:55:15,999 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 2023-11-12 00:55:15,999 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 2023-11-12 00:55:16,000 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c 2023-11-12 00:55:16,001 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 2023-11-12 00:55:16,001 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 2023-11-12 00:55:16,001 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-12 00:55:16,001 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112' 2023-11-12 00:55:16,009 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:16,009 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 2023-11-12 00:55:16,009 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-12 00:55:16,009 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112' 2023-11-12 00:55:16,010 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:16,735 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112257bdc98a6d64116b67bdecadabc4fbc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112257bdc98a6d64116b67bdecadabc4fbc 2023-11-12 00:55:16,736 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:16,759 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-12 00:55:16,760 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/7ddf265a82eb48c4b2bcc6ee1874bc50}] 2023-11-12 00:55:16,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 for inclusion in 5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:16,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-12 00:55:16,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last=1 2023-11-12 00:55:16,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:16,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__ffnnkqetj7aoe27e7dl2d2jkql15htmtp6plcighlc3ns3o66kcnngrfuk8gdeed/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 2023-11-12 00:55:16,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__ffnnkqetj7aoe27e7dl2d2jkql15htmtp6plcighlc3ns3o66kcnngrfuk8gdeed/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_ 2023-11-12 00:55:16,768 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__ffnnkqetj7aoe27e7dl2d2jkql15htmtp6plcighlc3ns3o66kcnngrfuk8gdeed/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 into 5f718172b15982a24b524747297f2bf3/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_ - updating store file list. 2023-11-12 00:55:16,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_ into 5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:16,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__ffnnkqetj7aoe27e7dl2d2jkql15htmtp6plcighlc3ns3o66kcnngrfuk8gdeed/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 into 5f718172b15982a24b524747297f2bf3/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_) 2023-11-12 00:55:16,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__ffnnkqetj7aoe27e7dl2d2jkql15htmtp6plcighlc3ns3o66kcnngrfuk8gdeed/family1/7ddf265a82eb48c4b2bcc6ee1874bc50 2023-11-12 00:55:16,773 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:16,773 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:16,774 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c 2023-11-12 00:55:16,775 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc 2023-11-12 00:55:16,776 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 2023-11-12 00:55:16,777 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 2023-11-12 00:55:16,777 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-12 00:55:16,777 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112' 2023-11-12 00:55:16,778 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:16,778 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:16,778 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:16,778 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del] 2023-11-12 00:55:16,778 DEBUG [Listener at localhost/40343] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:16,779 DEBUG [Listener at localhost/40343] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112ee6e5c9d8b8040079b0a269fd1c21c55_del 2023-11-12 00:55:16,780 INFO [Listener at localhost/40343] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-12 00:55:16,780 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del] 2023-11-12 00:55:16,780 DEBUG [Listener at localhost/40343] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:16,781 DEBUG [Listener at localhost/40343] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311126a9e1c84d27d4bd1a392f1c506fe6da4_del 2023-11-12 00:55:16,781 INFO [Listener at localhost/40343] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-12 00:55:16,781 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del] 2023-11-12 00:55:16,782 DEBUG [Listener at localhost/40343] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:16,783 DEBUG [Listener at localhost/40343] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231112cdfb544f8df240f181b6284dcd27ccd2_del 2023-11-12 00:55:16,783 INFO [Listener at localhost/40343] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-12 00:55:16,785 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:16,787 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:16,791 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:16,792 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:16,797 INFO [Listener at localhost/40343] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-12 00:55:16,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-12 00:55:16,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-12 00:55:16,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-12 00:55:16,805 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750516804"}]},"ts":"1699750516804"} 2023-11-12 00:55:16,806 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-12 00:55:16,808 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-12 00:55:16,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, UNASSIGN}] 2023-11-12 00:55:16,810 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, UNASSIGN 2023-11-12 00:55:16,810 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, UNASSIGN 2023-11-12 00:55:16,810 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, UNASSIGN 2023-11-12 00:55:16,811 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=5f718172b15982a24b524747297f2bf3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:16,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750516811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750516811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750516811"}]},"ts":"1699750516811"} 2023-11-12 00:55:16,811 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=30776669ce9a16f9418734b4c50a772b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:16,811 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=102e79e9eb9e2fd338dca31ed883a20f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:16,811 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750516811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750516811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750516811"}]},"ts":"1699750516811"} 2023-11-12 00:55:16,811 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750516811"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750516811"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750516811"}]},"ts":"1699750516811"} 2023-11-12 00:55:16,812 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 5f718172b15982a24b524747297f2bf3, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:16,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 30776669ce9a16f9418734b4c50a772b, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:16,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 102e79e9eb9e2fd338dca31ed883a20f, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:16,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-12 00:55:16,963 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:16,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:16,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f718172b15982a24b524747297f2bf3, disabling compactions & flushes 2023-11-12 00:55:16,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:16,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:16,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. after waiting 0 ms 2023-11-12 00:55:16,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:16,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-12 00:55:16,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:16,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:16,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:16,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:16,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 102e79e9eb9e2fd338dca31ed883a20f, disabling compactions & flushes 2023-11-12 00:55:16,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:16,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:16,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. after waiting 0 ms 2023-11-12 00:55:16,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:16,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=5f718172b15982a24b524747297f2bf3, regionState=CLOSED 2023-11-12 00:55:16,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750516971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750516971"}]},"ts":"1699750516971"} 2023-11-12 00:55:16,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=89 2023-11-12 00:55:16,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 5f718172b15982a24b524747297f2bf3, server=jenkins-hbase4.apache.org,43681,1699750400629 in 160 msec 2023-11-12 00:55:16,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-12 00:55:16,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, UNASSIGN in 166 msec 2023-11-12 00:55:16,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:16,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:16,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:16,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:16,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30776669ce9a16f9418734b4c50a772b, disabling compactions & flushes 2023-11-12 00:55:16,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:16,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:16,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. after waiting 0 ms 2023-11-12 00:55:16,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:16,977 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=102e79e9eb9e2fd338dca31ed883a20f, regionState=CLOSED 2023-11-12 00:55:16,977 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750516977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750516977"}]},"ts":"1699750516977"} 2023-11-12 00:55:16,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-11-12 00:55:16,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 102e79e9eb9e2fd338dca31ed883a20f, server=jenkins-hbase4.apache.org,43681,1699750400629 in 165 msec 2023-11-12 00:55:16,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, UNASSIGN in 171 msec 2023-11-12 00:55:16,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-12 00:55:16,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:16,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:16,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:16,982 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=30776669ce9a16f9418734b4c50a772b, regionState=CLOSED 2023-11-12 00:55:16,983 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750516982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750516982"}]},"ts":"1699750516982"} 2023-11-12 00:55:16,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=90 2023-11-12 00:55:16,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 30776669ce9a16f9418734b4c50a772b, server=jenkins-hbase4.apache.org,43681,1699750400629 in 171 msec 2023-11-12 00:55:16,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-11-12 00:55:16,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, UNASSIGN in 176 msec 2023-11-12 00:55:16,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750516986"}]},"ts":"1699750516986"} 2023-11-12 00:55:16,986 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-12 00:55:16,991 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-12 00:55:16,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 193 msec 2023-11-12 00:55:17,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-12 00:55:17,106 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-12 00:55:17,116 INFO [Listener at localhost/40343] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:17,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:17,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699750517117 (current time:1699750517117). 2023-11-12 00:55:17,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-12 00:55:17,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] zookeeper.ReadOnlyZKClient(139): Connect 0x2201a980 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:55:17,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@624406ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:55:17,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:55:17,126 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:55:17,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2201a980 to 127.0.0.1:60532 2023-11-12 00:55:17,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:17,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-12 00:55:17,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:17,129 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot, current working dir path: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699750508590-1699750517116 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-12 00:55:17,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-12 00:55:17,131 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-12 00:55:17,132 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699751117132 2023-11-12 00:55:17,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699750508590-1699750517116 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-12 00:55:17,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:17,132 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:17,132 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-12 00:55:17,232 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:17,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:17,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:17,234 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-12 00:55:17,434 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:17,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:17,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:17,435 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-12 00:55:17,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-12 00:55:17,540 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-12 00:55:17,543 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/88ee3498ac00448fbc2f996f60a23f21, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_] hfiles 2023-11-12 00:55:17,543 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/88ee3498ac00448fbc2f996f60a23f21 2023-11-12 00:55:17,543 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/7b6fb2ff410c44609cc491e983a8bb5c] hfiles 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/577fe66a72cd4bc78c43beaa195dff6e] hfiles 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112470a2df1535d4c6a92ecfc8f4dac42fb, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111282e6b37b085c4b4a90c5ff1646a4042a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112257bdc98a6d64116b67bdecadabc4fbc] hfiles 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_ 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_ 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/7b6fb2ff410c44609cc491e983a8bb5c 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112470a2df1535d4c6a92ecfc8f4dac42fb 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_ 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111282e6b37b085c4b4a90c5ff1646a4042a 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/577fe66a72cd4bc78c43beaa195dff6e 2023-11-12 00:55:17,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112257bdc98a6d64116b67bdecadabc4fbc 2023-11-12 00:55:17,545 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ff00c21442844ce0b5b0372f96b70fcd] hfiles 2023-11-12 00:55:17,545 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ff00c21442844ce0b5b0372f96b70fcd 2023-11-12 00:55:17,545 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/7a00d65e5609451888d5f38db0e95b27] hfiles 2023-11-12 00:55:17,545 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/7a00d65e5609451888d5f38db0e95b27 2023-11-12 00:55:17,545 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8bf38d881dc84a72848b0f169330a3d1] hfiles 2023-11-12 00:55:17,545 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8bf38d881dc84a72848b0f169330a3d1 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111200ac3d4447ea4bc3878801106c1bb8b5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112118447953fec4ba381f93178056647b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311127d0db20bd6004a1199f58944724d3ff5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112dbd6dd5f5bf1476781c71cd62072fdec, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311121eb1db6b919a4d2da18e7a72419b8a22, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111262ff3b78f7c24851a837073c76773e6f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111266ba76024d1341658a3ef386b5bdf7d9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311128bca0876ac8e4626a90fde33f7fbdf9c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111225a1716c1136439fabd37bb0d0401bd2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112686bac2bb57042ec9785fe59aee6be97, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311127ce9f73d75ba4c61bc020af6ab31a59c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112beb254e80d824082a7714d1448706bcd] hfiles 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111200ac3d4447ea4bc3878801106c1bb8b5 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112118447953fec4ba381f93178056647b2 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311127d0db20bd6004a1199f58944724d3ff5 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112dbd6dd5f5bf1476781c71cd62072fdec 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311121eb1db6b919a4d2da18e7a72419b8a22 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111262ff3b78f7c24851a837073c76773e6f 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111266ba76024d1341658a3ef386b5bdf7d9 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311128bca0876ac8e4626a90fde33f7fbdf9c 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111225a1716c1136439fabd37bb0d0401bd2 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112686bac2bb57042ec9785fe59aee6be97 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311127ce9f73d75ba4c61bc020af6ab31a59c 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del 2023-11-12 00:55:17,552 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231112beb254e80d824082a7714d1448706bcd 2023-11-12 00:55:17,735 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:17,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:17,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:17,736 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-12 00:55:17,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-12 00:55:17,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:17,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:18,237 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:18,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:18,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-12 00:55:18,238 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-12 00:55:18,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699750508590-1699750517116 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:18,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699750508590-1699750517116 of table testCompactionWithHFileLink completed 2023-11-12 00:55:18,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:18,382 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:18,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699750508590-1699750517116 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699750517132Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699750517538 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699750508590-1699750517116 at 1699750517951 (+413 ms)Loading Region manifests for hbase-failsafe-snaptb-1699750508590-1699750517116 at 1699750517951Writing data manifest for hbase-failsafe-snaptb-1699750508590-1699750517116 at 1699750517954 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1699750508590-1699750517116 at 1699750518360 (+406 ms)Snapshot hbase-failsafe-snaptb-1699750508590-1699750517116 of table testCompactionWithHFileLink completed at 1699750518381 (+21 ms) 2023-11-12 00:55:18,383 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-12 00:55:18,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2530 sec 2023-11-12 00:55:19,238 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-12 00:55:19,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-12 00:55:19,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699750508590-1699750517116 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-12 00:55:19,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699750508590" table: "testCompactionWithHFileLink" creation_time: 1699750508604 type: FLUSH version: 2 ttl: 0 ) 2023-11-12 00:55:19,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699750508590 as table=testCompactionWithHFileLink 2023-11-12 00:55:19,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-12 00:55:19,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-12 00:55:19,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-12 00:55:19,697 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-12 00:55:19,698 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-12 00:55:19,698 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-12 00:55:19,699 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-12 00:55:19,703 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699750508590" table: "testCompactionWithHFileLink" creation_time: 1699750508604 type: FLUSH version: 2 ttl: 0 2023-11-12 00:55:19,704 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink 2023-11-12 00:55:19,708 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-12 00:55:19,712 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112470a2df1535d4c6a92ecfc8f4dac42fb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112470a2df1535d4c6a92ecfc8f4dac42fb 2023-11-12 00:55:19,713 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111282e6b37b085c4b4a90c5ff1646a4042a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111282e6b37b085c4b4a90c5ff1646a4042a 2023-11-12 00:55:19,714 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112257bdc98a6d64116b67bdecadabc4fbc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231112257bdc98a6d64116b67bdecadabc4fbc 2023-11-12 00:55:19,714 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,718 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,721 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,724 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,727 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,730 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,734 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,736 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,739 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,742 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,744 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,747 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 of snapshot=snaptb-1699750508590 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-12 00:55:19,751 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111286daae13cbc9457f97304260ae7b2955_del 2023-11-12 00:55:19,752 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231112addfd05328074a18b4b83e1d253f8057_del 2023-11-12 00:55:19,753 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231112153d3c66789244b484d5f22b9b259198_del 2023-11-12 00:55:19,754 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:19,754 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:19,754 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:19,757 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/9919da759a2b4afa8402c2094f9e2701_SeqId_29_ 2023-11-12 00:55:19,757 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/7b6fb2ff410c44609cc491e983a8bb5c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/7b6fb2ff410c44609cc491e983a8bb5c 2023-11-12 00:55:19,758 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/137fdc6044de48f09de70119b1979501_SeqId_29_ 2023-11-12 00:55:19,759 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/88ee3498ac00448fbc2f996f60a23f21 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/88ee3498ac00448fbc2f996f60a23f21 2023-11-12 00:55:19,759 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fef1611765f04a04b70c752a8ae1d605 of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,759 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/33a6f32460e244f4ad8e46fdd8de7295_SeqId_29_ 2023-11-12 00:55:19,759 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 31b5d21274c548739ca9685789215539 of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,759 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/577fe66a72cd4bc78c43beaa195dff6e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/577fe66a72cd4bc78c43beaa195dff6e 2023-11-12 00:55:19,759 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 26469a7002c24fd3892c318f1423b6b2 of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,765 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4fd01fa062a74a8ea6b837cf616cd82b of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,765 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c8eb87f8ec604c06b63fd0971e801be7 of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,777 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a9a8acbbce0a45a39537c3e49b2d1b95 of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,778 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eb55b08266c74d889c8d132e4cae2bb2 of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,782 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1400c34bf4f64bed89b13790495daae1 of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,785 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 265c665fce0e4965ade65a20468a1bfc of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,786 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 453ce9c2bb9846c58663b45e4fa325d5 of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,787 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1346f658d44f4de392b9a20ba9b1aff9 of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,790 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a089a6fd33734e2eaf7fb36e80c2a75a of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,791 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8bf38d881dc84a72848b0f169330a3d1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/8bf38d881dc84a72848b0f169330a3d1 2023-11-12 00:55:19,791 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8d8ed76f1c7d449b9a50e0064607d8f9 of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,793 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/7a00d65e5609451888d5f38db0e95b27 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/7a00d65e5609451888d5f38db0e95b27 2023-11-12 00:55:19,793 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5113b5ffb2334955be6dfb67e90ef4db of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,796 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ff00c21442844ce0b5b0372f96b70fcd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/ff00c21442844ce0b5b0372f96b70fcd 2023-11-12 00:55:19,796 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c529a375558f4c678ce4be07f1c9471f of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,798 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 91f30e370a0a40d5a89f897a57239cca of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,798 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 248a303fdbd944b7824fe022c70905dd of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,799 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2e50f32e1b2d4f639da3ea2cd42bc489 of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,803 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1b168663b90841d68a76d0dadf5ec19a of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,803 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f26ae267ec3846a9a8676435cabb0b77 of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,805 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 91cce381f8b547fdbcd271d600847505 of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,809 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7a711cfaf51640fa8e9c47039b6399aa of snapshot=snaptb-1699750508590 to region=5f718172b15982a24b524747297f2bf3 table=testCompactionWithHFileLink 2023-11-12 00:55:19,809 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4104d0a9f25544b1b8a24e0ae6728474 of snapshot=snaptb-1699750508590 to region=30776669ce9a16f9418734b4c50a772b table=testCompactionWithHFileLink 2023-11-12 00:55:19,811 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ada3a60ad9424c099c512d74a686053a of snapshot=snaptb-1699750508590 to region=102e79e9eb9e2fd338dca31ed883a20f table=testCompactionWithHFileLink 2023-11-12 00:55:19,814 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699750508590" table: "testCompactionWithHFileLink" creation_time: 1699750508604 type: FLUSH version: 2 ttl: 0 2023-11-12 00:55:19,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699750519815"}]},"ts":"9223372036854775807"} 2023-11-12 00:55:19,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699750519815"}]},"ts":"9223372036854775807"} 2023-11-12 00:55:19,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699750519815"}]},"ts":"9223372036854775807"} 2023-11-12 00:55:19,817 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-12 00:55:19,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 102e79e9eb9e2fd338dca31ed883a20f, NAME => 'testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 30776669ce9a16f9418734b4c50a772b, NAME => 'testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 5f718172b15982a24b524747297f2bf3, NAME => 'testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.', STARTKEY => '', ENDKEY => '1'}] 2023-11-12 00:55:19,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750519816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750519816"}]},"ts":"1699750519816"} 2023-11-12 00:55:19,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750519816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750519816"}]},"ts":"1699750519816"} 2023-11-12 00:55:19,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750519816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750519816"}]},"ts":"1699750519816"} 2023-11-12 00:55:19,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-12 00:55:19,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-12 00:55:19,818 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 102e79e9eb9e2fd338dca31ed883a20f, NAME => 'testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 30776669ce9a16f9418734b4c50a772b, NAME => 'testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 5f718172b15982a24b524747297f2bf3, NAME => 'testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.', STARTKEY => '', ENDKEY => '1'}] 2023-11-12 00:55:19,819 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699750508590 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-12 00:55:19,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699750508590" table: "testCompactionWithHFileLink" creation_time: 1699750508604 type: FLUSH version: 2 ttl: 0 ) in 546 msec 2023-11-12 00:55:19,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-12 00:55:19,894 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-12 00:55:19,894 INFO [Listener at localhost/40343] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:19,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1699750508590-1699750517116" 2023-11-12 00:55:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699750508590-1699750517116 2023-11-12 00:55:19,903 INFO [Listener at localhost/40343] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-12 00:55:19,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-12 00:55:19,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-12 00:55:19,915 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-12 00:55:19,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-12 00:55:19,916 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750519916"}]},"ts":"1699750519916"} 2023-11-12 00:55:19,917 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-12 00:55:19,919 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-12 00:55:19,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN}] 2023-11-12 00:55:19,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN 2023-11-12 00:55:19,921 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN 2023-11-12 00:55:19,921 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN 2023-11-12 00:55:19,921 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-12 00:55:19,921 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-12 00:55:19,921 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-12 00:55:20,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-12 00:55:20,073 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=30776669ce9a16f9418734b4c50a772b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,073 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=102e79e9eb9e2fd338dca31ed883a20f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,073 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=5f718172b15982a24b524747297f2bf3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,073 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750520073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750520073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750520073"}]},"ts":"1699750520073"} 2023-11-12 00:55:20,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750520073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750520073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750520073"}]},"ts":"1699750520073"} 2023-11-12 00:55:20,073 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750520073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750520073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750520073"}]},"ts":"1699750520073"} 2023-11-12 00:55:20,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 30776669ce9a16f9418734b4c50a772b, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:20,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 102e79e9eb9e2fd338dca31ed883a20f, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:20,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 5f718172b15982a24b524747297f2bf3, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:20,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-12 00:55:20,226 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:20,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30776669ce9a16f9418734b4c50a772b, NAME => 'testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.', STARTKEY => '1', ENDKEY => '2'} 2023-11-12 00:55:20,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:20,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,230 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,231 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:20,231 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:20,231 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30776669ce9a16f9418734b4c50a772b columnFamilyName family1 2023-11-12 00:55:20,241 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1346f658d44f4de392b9a20ba9b1aff9 2023-11-12 00:55:20,245 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1400c34bf4f64bed89b13790495daae1 2023-11-12 00:55:20,250 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-26469a7002c24fd3892c318f1423b6b2 2023-11-12 00:55:20,256 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-a9a8acbbce0a45a39537c3e49b2d1b95 2023-11-12 00:55:20,256 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(310): Store=30776669ce9a16f9418734b4c50a772b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:20,256 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,257 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2 2023-11-12 00:55:20,257 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2 2023-11-12 00:55:20,258 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30776669ce9a16f9418734b4c50a772b columnFamilyName family2 2023-11-12 00:55:20,265 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-248a303fdbd944b7824fe022c70905dd 2023-11-12 00:55:20,270 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-4104d0a9f25544b1b8a24e0ae6728474 2023-11-12 00:55:20,275 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-5113b5ffb2334955be6dfb67e90ef4db 2023-11-12 00:55:20,281 DEBUG [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-f26ae267ec3846a9a8676435cabb0b77 2023-11-12 00:55:20,281 INFO [StoreOpener-30776669ce9a16f9418734b4c50a772b-1] regionserver.HStore(310): Store=30776669ce9a16f9418734b4c50a772b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:20,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:20,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:55:20,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30776669ce9a16f9418734b4c50a772b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68581146, jitterRate=0.021938711404800415}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:20,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:20,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b., pid=101, masterSystemTime=1699750520226 2023-11-12 00:55:20,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:20,288 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-12 00:55:20,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-12 00:55:20,288 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-12 00:55:20,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:20,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:20,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:20,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 102e79e9eb9e2fd338dca31ed883a20f, NAME => 'testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.', STARTKEY => '2', ENDKEY => ''} 2023-11-12 00:55:20,290 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=30776669ce9a16f9418734b4c50a772b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,291 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750520290"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750520290"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750520290"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750520290"}]},"ts":"1699750520290"} 2023-11-12 00:55:20,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:20,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,292 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-12 00:55:20,293 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1912): 30776669ce9a16f9418734b4c50a772b/family2 is initiating minor compaction (all files) 2023-11-12 00:55:20,292 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-12 00:55:20,293 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 30776669ce9a16f9418734b4c50a772b/family2 in testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:20,293 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1912): 30776669ce9a16f9418734b4c50a772b/family1 is initiating minor compaction (all files) 2023-11-12 00:55:20,293 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,293 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 30776669ce9a16f9418734b4c50a772b/family1 in testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:55:20,293 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-26469a7002c24fd3892c318f1423b6b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-a9a8acbbce0a45a39537c3e49b2d1b95, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1400c34bf4f64bed89b13790495daae1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1346f658d44f4de392b9a20ba9b1aff9] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp, totalSize=21.6 K 2023-11-12 00:55:20,293 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-5113b5ffb2334955be6dfb67e90ef4db, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-248a303fdbd944b7824fe022c70905dd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-f26ae267ec3846a9a8676435cabb0b77, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-4104d0a9f25544b1b8a24e0ae6728474] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp, totalSize=20.4 K 2023-11-12 00:55:20,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-11-12 00:55:20,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 30776669ce9a16f9418734b4c50a772b, server=jenkins-hbase4.apache.org,43681,1699750400629 in 218 msec 2023-11-12 00:55:20,294 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-5113b5ffb2334955be6dfb67e90ef4db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502944 2023-11-12 00:55:20,294 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:20,295 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-26469a7002c24fd3892c318f1423b6b2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502944 2023-11-12 00:55:20,295 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:20,295 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 102e79e9eb9e2fd338dca31ed883a20f columnFamilyName family1 2023-11-12 00:55:20,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=30776669ce9a16f9418734b4c50a772b, ASSIGN in 375 msec 2023-11-12 00:55:20,295 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-a9a8acbbce0a45a39537c3e49b2d1b95, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:20,296 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-248a303fdbd944b7824fe022c70905dd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:20,296 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1400c34bf4f64bed89b13790495daae1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:20,297 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-f26ae267ec3846a9a8676435cabb0b77, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:20,297 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1346f658d44f4de392b9a20ba9b1aff9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:20,298 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-4104d0a9f25544b1b8a24e0ae6728474, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:20,308 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-453ce9c2bb9846c58663b45e4fa325d5 2023-11-12 00:55:20,318 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-a089a6fd33734e2eaf7fb36e80c2a75a 2023-11-12 00:55:20,327 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c8eb87f8ec604c06b63fd0971e801be7 2023-11-12 00:55:20,333 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] throttle.PressureAwareThroughputController(145): 30776669ce9a16f9418734b4c50a772b#family2#compaction#115 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:55:20,334 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-fef1611765f04a04b70c752a8ae1d605 2023-11-12 00:55:20,337 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(310): Store=102e79e9eb9e2fd338dca31ed883a20f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:20,337 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 30776669ce9a16f9418734b4c50a772b#family1#compaction#114 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:55:20,337 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,338 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2 2023-11-12 00:55:20,338 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2 2023-11-12 00:55:20,339 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 102e79e9eb9e2fd338dca31ed883a20f columnFamilyName family2 2023-11-12 00:55:20,346 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-2e50f32e1b2d4f639da3ea2cd42bc489 2023-11-12 00:55:20,350 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-91cce381f8b547fdbcd271d600847505 2023-11-12 00:55:20,354 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-ada3a60ad9424c099c512d74a686053a 2023-11-12 00:55:20,357 DEBUG [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c529a375558f4c678ce4be07f1c9471f 2023-11-12 00:55:20,357 INFO [StoreOpener-102e79e9eb9e2fd338dca31ed883a20f-1] regionserver.HStore(310): Store=102e79e9eb9e2fd338dca31ed883a20f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:20,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:20,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:55:20,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 102e79e9eb9e2fd338dca31ed883a20f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67430492, jitterRate=0.004792630672454834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:20,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:20,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f., pid=102, masterSystemTime=1699750520226 2023-11-12 00:55:20,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-12 00:55:20,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-12 00:55:20,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:20,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:20,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:20,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f718172b15982a24b524747297f2bf3, NAME => 'testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.', STARTKEY => '', ENDKEY => '1'} 2023-11-12 00:55:20,364 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=102e79e9eb9e2fd338dca31ed883a20f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:20,365 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750520364"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750520364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750520364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750520364"}]},"ts":"1699750520364"} 2023-11-12 00:55:20,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,366 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,367 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:20,367 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:20,367 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f718172b15982a24b524747297f2bf3 columnFamilyName family1 2023-11-12 00:55:20,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-11-12 00:55:20,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 102e79e9eb9e2fd338dca31ed883a20f, server=jenkins-hbase4.apache.org,43681,1699750400629 in 291 msec 2023-11-12 00:55:20,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=102e79e9eb9e2fd338dca31ed883a20f, ASSIGN in 448 msec 2023-11-12 00:55:20,376 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-265c665fce0e4965ade65a20468a1bfc 2023-11-12 00:55:20,380 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-31b5d21274c548739ca9685789215539 2023-11-12 00:55:20,384 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-4fd01fa062a74a8ea6b837cf616cd82b 2023-11-12 00:55:20,389 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-eb55b08266c74d889c8d132e4cae2bb2 2023-11-12 00:55:20,389 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(310): Store=5f718172b15982a24b524747297f2bf3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:20,389 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,390 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2 2023-11-12 00:55:20,390 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2 2023-11-12 00:55:20,390 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f718172b15982a24b524747297f2bf3 columnFamilyName family2 2023-11-12 00:55:20,397 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-1b168663b90841d68a76d0dadf5ec19a 2023-11-12 00:55:20,403 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-7a711cfaf51640fa8e9c47039b6399aa 2023-11-12 00:55:20,412 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-8d8ed76f1c7d449b9a50e0064607d8f9 2023-11-12 00:55:20,418 DEBUG [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(539): loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-91f30e370a0a40d5a89f897a57239cca 2023-11-12 00:55:20,419 INFO [StoreOpener-5f718172b15982a24b524747297f2bf3-1] regionserver.HStore(310): Store=5f718172b15982a24b524747297f2bf3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:20,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:20,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:55:20,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f718172b15982a24b524747297f2bf3; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71764049, jitterRate=0.0693676620721817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:20,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:20,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3., pid=103, masterSystemTime=1699750520226 2023-11-12 00:55:20,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-12 00:55:20,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-12 00:55:20,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:20,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:20,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=5f718172b15982a24b524747297f2bf3, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:20,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699750520426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750520426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750520426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750520426"}]},"ts":"1699750520426"} 2023-11-12 00:55:20,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-11-12 00:55:20,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 5f718172b15982a24b524747297f2bf3, server=jenkins-hbase4.apache.org,43681,1699750400629 in 353 msec 2023-11-12 00:55:20,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-11-12 00:55:20,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5f718172b15982a24b524747297f2bf3, ASSIGN in 510 msec 2023-11-12 00:55:20,431 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750520431"}]},"ts":"1699750520431"} 2023-11-12 00:55:20,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-12 00:55:20,434 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-12 00:55:20,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 527 msec 2023-11-12 00:55:20,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-12 00:55:20,519 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-12 00:55:20,534 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:20,546 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:20,557 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:20,558 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:20,565 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-12 00:55:20,582 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-12 00:55:20,582 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:20,583 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(139): Connect 0x5aaab782 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:55:20,588 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21d1d175, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:55:20,588 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:20,588 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:20,588 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:20,677 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311125106a0ecd3804958b47ed989e6b7da0d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311125106a0ecd3804958b47ed989e6b7da0d 2023-11-12 00:55:20,678 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:20,690 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:55:20,693 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:55:20,698 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:55:20,707 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:55:20,717 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/6c2e4b64e6dd401582717c351ff403bc first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-12 00:55:20,717 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=32 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/6c2e4b64e6dd401582717c351ff403bc}] 2023-11-12 00:55:20,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/6c2e4b64e6dd401582717c351ff403bc for inclusion in 5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:20,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-12 00:55:20,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last=1 2023-11-12 00:55:20,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:20,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112/family1/6c2e4b64e6dd401582717c351ff403bc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__l50erf0rbpu119qgsmbss7j8cujkp8uj8esc0qo6qbm72rnvis8bgc8bp9b2dna5/family1/6c2e4b64e6dd401582717c351ff403bc 2023-11-12 00:55:20,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__l50erf0rbpu119qgsmbss7j8cujkp8uj8esc0qo6qbm72rnvis8bgc8bp9b2dna5/family1/6c2e4b64e6dd401582717c351ff403bc as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_ 2023-11-12 00:55:20,727 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__l50erf0rbpu119qgsmbss7j8cujkp8uj8esc0qo6qbm72rnvis8bgc8bp9b2dna5/family1/6c2e4b64e6dd401582717c351ff403bc into 5f718172b15982a24b524747297f2bf3/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_ - updating store file list. 2023-11-12 00:55:20,730 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_ into 5f718172b15982a24b524747297f2bf3/family1 2023-11-12 00:55:20,730 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__l50erf0rbpu119qgsmbss7j8cujkp8uj8esc0qo6qbm72rnvis8bgc8bp9b2dna5/family1/6c2e4b64e6dd401582717c351ff403bc into 5f718172b15982a24b524747297f2bf3/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_) 2023-11-12 00:55:20,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__l50erf0rbpu119qgsmbss7j8cujkp8uj8esc0qo6qbm72rnvis8bgc8bp9b2dna5/family1/6c2e4b64e6dd401582717c351ff403bc 2023-11-12 00:55:20,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:20,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-12 00:55:20,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(1912): 5f718172b15982a24b524747297f2bf3/family1 is initiating minor compaction (all files) 2023-11-12 00:55:20,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1d749cf8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-12 00:55:20,735 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:20,735 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:20,737 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231112125d22698f644976a953c2bc16a6170c 2023-11-12 00:55:20,737 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111290434ba5152c42a99cfeb80b38a39edc 2023-11-12 00:55:20,738 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231112b110f5e2526f44d0af03dd79b611eea0 2023-11-12 00:55:20,739 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231112bdfe4ae58ff4407ead88b568c56d6617 2023-11-12 00:55:20,739 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-12 00:55:20,739 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231112' 2023-11-12 00:55:20,740 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:21,155 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family2/02c43994603b4d989e101286336c7e08 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/02c43994603b4d989e101286336c7e08 2023-11-12 00:55:21,160 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 30776669ce9a16f9418734b4c50a772b/family2 of 30776669ce9a16f9418734b4c50a772b into 02c43994603b4d989e101286336c7e08(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:21,160 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:21,160 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b., storeName=30776669ce9a16f9418734b4c50a772b/family2, priority=12, startTime=1699750520288; duration=0sec 2023-11-12 00:55:21,160 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-12 00:55:21,160 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5f718172b15982a24b524747297f2bf3/family1 in testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:21,160 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-31b5d21274c548739ca9685789215539, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-4fd01fa062a74a8ea6b837cf616cd82b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-eb55b08266c74d889c8d132e4cae2bb2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-265c665fce0e4965ade65a20468a1bfc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp, totalSize=28.9 K 2023-11-12 00:55:21,161 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-31b5d21274c548739ca9685789215539, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502943 2023-11-12 00:55:21,162 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-4fd01fa062a74a8ea6b837cf616cd82b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:21,162 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-eb55b08266c74d889c8d132e4cae2bb2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:21,163 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-265c665fce0e4965ade65a20468a1bfc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:21,163 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting 71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699750502943 2023-11-12 00:55:21,177 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] throttle.PressureAwareThroughputController(145): 5f718172b15982a24b524747297f2bf3#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:55:21,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-5113b5ffb2334955be6dfb67e90ef4db, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-248a303fdbd944b7824fe022c70905dd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-f26ae267ec3846a9a8676435cabb0b77, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-4104d0a9f25544b1b8a24e0ae6728474] to archive 2023-11-12 00:55:21,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:21,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-5113b5ffb2334955be6dfb67e90ef4db to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-5113b5ffb2334955be6dfb67e90ef4db 2023-11-12 00:55:21,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-248a303fdbd944b7824fe022c70905dd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-248a303fdbd944b7824fe022c70905dd 2023-11-12 00:55:21,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-f26ae267ec3846a9a8676435cabb0b77 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-f26ae267ec3846a9a8676435cabb0b77 2023-11-12 00:55:21,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-4104d0a9f25544b1b8a24e0ae6728474 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family2/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-4104d0a9f25544b1b8a24e0ae6728474 2023-11-12 00:55:21,472 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111243b57c9fe2ef449f92f51f628c7db811 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111243b57c9fe2ef449f92f51f628c7db811 2023-11-12 00:55:21,473 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:21,476 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112c4379122f6d7489f995e18bcc30a4da7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231112c4379122f6d7489f995e18bcc30a4da7 2023-11-12 00:55:21,477 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:21,500 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-12 00:55:21,500 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0}] 2023-11-12 00:55:21,503 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/4026d47fdda246a3ac5e1e4bfc758650 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-12 00:55:21,503 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/4026d47fdda246a3ac5e1e4bfc758650}] 2023-11-12 00:55:21,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 for inclusion in 102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:21,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/4026d47fdda246a3ac5e1e4bfc758650 for inclusion in 30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-12 00:55:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-12 00:55:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__1ubvo601j0marf0h719hj9tjsv741c33qhkd1vsvddvt0454i41pitejcrenetd1/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 2023-11-12 00:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-12 00:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-12 00:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:21,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112/family1/4026d47fdda246a3ac5e1e4bfc758650 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__oqgkhhf9l3kvnilq7fe4th70k6vtrmc6du1uhlok4rpp4n1knenotpsfeeucnf57/family1/4026d47fdda246a3ac5e1e4bfc758650 2023-11-12 00:55:21,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__1ubvo601j0marf0h719hj9tjsv741c33qhkd1vsvddvt0454i41pitejcrenetd1/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_ 2023-11-12 00:55:21,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__1ubvo601j0marf0h719hj9tjsv741c33qhkd1vsvddvt0454i41pitejcrenetd1/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 into 102e79e9eb9e2fd338dca31ed883a20f/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_ - updating store file list. 2023-11-12 00:55:21,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__oqgkhhf9l3kvnilq7fe4th70k6vtrmc6du1uhlok4rpp4n1knenotpsfeeucnf57/family1/4026d47fdda246a3ac5e1e4bfc758650 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/4a9dbaa0b9ae44b9b5301cc9ce7892d4_SeqId_35_ 2023-11-12 00:55:21,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__oqgkhhf9l3kvnilq7fe4th70k6vtrmc6du1uhlok4rpp4n1knenotpsfeeucnf57/family1/4026d47fdda246a3ac5e1e4bfc758650 into 30776669ce9a16f9418734b4c50a772b/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/4a9dbaa0b9ae44b9b5301cc9ce7892d4_SeqId_35_ - updating store file list. 2023-11-12 00:55:21,518 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_ into 102e79e9eb9e2fd338dca31ed883a20f/family1 2023-11-12 00:55:21,518 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__1ubvo601j0marf0h719hj9tjsv741c33qhkd1vsvddvt0454i41pitejcrenetd1/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 into 102e79e9eb9e2fd338dca31ed883a20f/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_) 2023-11-12 00:55:21,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__1ubvo601j0marf0h719hj9tjsv741c33qhkd1vsvddvt0454i41pitejcrenetd1/family1/4aba7d0cc10f4e6cbdeda4ed0dbdb5f0 2023-11-12 00:55:21,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:21,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/4a9dbaa0b9ae44b9b5301cc9ce7892d4_SeqId_35_ into 30776669ce9a16f9418734b4c50a772b/family1 2023-11-12 00:55:21,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__oqgkhhf9l3kvnilq7fe4th70k6vtrmc6du1uhlok4rpp4n1knenotpsfeeucnf57/family1/4026d47fdda246a3ac5e1e4bfc758650 into 30776669ce9a16f9418734b4c50a772b/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/4a9dbaa0b9ae44b9b5301cc9ce7892d4_SeqId_35_) 2023-11-12 00:55:21,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testCompactionWithHFileLink__oqgkhhf9l3kvnilq7fe4th70k6vtrmc6du1uhlok4rpp4n1knenotpsfeeucnf57/family1/4026d47fdda246a3ac5e1e4bfc758650 2023-11-12 00:55:21,521 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:21,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-12 00:55:21,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(1912): 102e79e9eb9e2fd338dca31ed883a20f/family1 is initiating minor compaction (all files) 2023-11-12 00:55:21,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1d4d77ff; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-12 00:55:21,522 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:21,523 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:21,523 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311121c9374f5f7084fa0887cae478d23eaeb 2023-11-12 00:55:21,524 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:21,525 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111221f21f70c73f400f9bcf6f54b242f124 2023-11-12 00:55:21,526 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112d932bc82bba14190a490d1d486f96db1 2023-11-12 00:55:21,526 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311122e9be507ed88423d9605b6eb7c704559 2023-11-12 00:55:21,527 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112e2fc3add1d144c15851b9cb8745c4890 2023-11-12 00:55:21,527 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231112562b831bbb0844fcbb7d4049e5f5d2c3 2023-11-12 00:55:21,527 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-12 00:55:21,527 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231112' 2023-11-12 00:55:21,528 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:21,528 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112fc2202d3720f4e9b8016aa6f664e150c 2023-11-12 00:55:21,529 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231112fc9ab0a734754711911565991e3c5c59 2023-11-12 00:55:21,529 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-12 00:55:21,529 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231112' 2023-11-12 00:55:21,530 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231112 for table='testCompactionWithHFileLink' and column='family1' 2023-11-12 00:55:21,530 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-12 00:55:21,532 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:21,535 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:21,537 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:21,538 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:21,545 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:21,546 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:21,559 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/.tmp/family1/02b76503810c4bd2bf28cb27d061b64e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/02b76503810c4bd2bf28cb27d061b64e 2023-11-12 00:55:21,563 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=293 (was 240) - Thread LEAK? -, OpenFileDescriptor=797 (was 625) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 130) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=1119 (was 819) - AvailableMemoryMB LEAK? - 2023-11-12 00:55:21,566 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 30776669ce9a16f9418734b4c50a772b/family1 of 30776669ce9a16f9418734b4c50a772b into 02b76503810c4bd2bf28cb27d061b64e(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:21,566 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:55:21,566 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b., storeName=30776669ce9a16f9418734b4c50a772b/family1, priority=12, startTime=1699750520287; duration=1sec 2023-11-12 00:55:21,566 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-12 00:55:21,566 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 102e79e9eb9e2fd338dca31ed883a20f/family1 in testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:21,566 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-fef1611765f04a04b70c752a8ae1d605, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c8eb87f8ec604c06b63fd0971e801be7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-453ce9c2bb9846c58663b45e4fa325d5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-a089a6fd33734e2eaf7fb36e80c2a75a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp, totalSize=28.9 K 2023-11-12 00:55:21,567 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-fef1611765f04a04b70c752a8ae1d605, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502945 2023-11-12 00:55:21,567 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c8eb87f8ec604c06b63fd0971e801be7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:21,568 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-453ce9c2bb9846c58663b45e4fa325d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:21,569 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-a089a6fd33734e2eaf7fb36e80c2a75a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:21,569 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699750502945 2023-11-12 00:55:21,576 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=292, OpenFileDescriptor=797, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=169, AvailableMemoryMB=1118 2023-11-12 00:55:21,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-12 00:55:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-12 00:55:21,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-12 00:55:21,588 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 102e79e9eb9e2fd338dca31ed883a20f#family1#compaction#117 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:55:21,589 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-12 00:55:21,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-11-12 00:55:21,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-26469a7002c24fd3892c318f1423b6b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-a9a8acbbce0a45a39537c3e49b2d1b95, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1400c34bf4f64bed89b13790495daae1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1346f658d44f4de392b9a20ba9b1aff9] to archive 2023-11-12 00:55:21,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:21,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-26469a7002c24fd3892c318f1423b6b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-26469a7002c24fd3892c318f1423b6b2 2023-11-12 00:55:21,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-a9a8acbbce0a45a39537c3e49b2d1b95 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-a9a8acbbce0a45a39537c3e49b2d1b95 2023-11-12 00:55:21,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1400c34bf4f64bed89b13790495daae1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1400c34bf4f64bed89b13790495daae1 2023-11-12 00:55:21,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1346f658d44f4de392b9a20ba9b1aff9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/family1/testCompactionWithHFileLink=30776669ce9a16f9418734b4c50a772b-1346f658d44f4de392b9a20ba9b1aff9 2023-11-12 00:55:21,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-12 00:55:21,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-12 00:55:21,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-12 00:55:21,692 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:55:21,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-12 00:55:21,693 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:55:21,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-12 00:55:21,695 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:21,695 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:21,695 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:21,695 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c empty. 2023-11-12 00:55:21,695 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0 empty. 2023-11-12 00:55:21,695 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0 empty. 2023-11-12 00:55:21,696 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:21,696 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:21,696 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:21,696 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-12 00:55:21,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-12 00:55:21,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-12 00:55:21,998 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family1/48f3f9e852744e5ba499f0d46c4acc3e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/48f3f9e852744e5ba499f0d46c4acc3e 2023-11-12 00:55:22,003 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 5f718172b15982a24b524747297f2bf3/family1 of 5f718172b15982a24b524747297f2bf3 into 48f3f9e852744e5ba499f0d46c4acc3e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:22,003 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699750520733; duration=0sec 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. because compaction request was cancelled 2023-11-12 00:55:22,003 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-12 00:55:22,005 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-12 00:55:22,005 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1912): 5f718172b15982a24b524747297f2bf3/family2 is initiating minor compaction (all files) 2023-11-12 00:55:22,005 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5f718172b15982a24b524747297f2bf3/family2 in testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:55:22,006 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-8d8ed76f1c7d449b9a50e0064607d8f9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-91f30e370a0a40d5a89f897a57239cca, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-1b168663b90841d68a76d0dadf5ec19a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-7a711cfaf51640fa8e9c47039b6399aa] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp, totalSize=20.4 K 2023-11-12 00:55:22,006 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-8d8ed76f1c7d449b9a50e0064607d8f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502943 2023-11-12 00:55:22,007 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-91f30e370a0a40d5a89f897a57239cca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:22,007 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-1b168663b90841d68a76d0dadf5ec19a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:22,008 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-7a711cfaf51640fa8e9c47039b6399aa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:22,019 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] throttle.PressureAwareThroughputController(145): 5f718172b15982a24b524747297f2bf3#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-11-12 00:55:22,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-31b5d21274c548739ca9685789215539, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-4fd01fa062a74a8ea6b837cf616cd82b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-eb55b08266c74d889c8d132e4cae2bb2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-265c665fce0e4965ade65a20468a1bfc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_] to archive 2023-11-12 00:55:22,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:22,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-31b5d21274c548739ca9685789215539 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-31b5d21274c548739ca9685789215539 2023-11-12 00:55:22,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-4fd01fa062a74a8ea6b837cf616cd82b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-4fd01fa062a74a8ea6b837cf616cd82b 2023-11-12 00:55:22,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-eb55b08266c74d889c8d132e4cae2bb2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-eb55b08266c74d889c8d132e4cae2bb2 2023-11-12 00:55:22,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-265c665fce0e4965ade65a20468a1bfc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-265c665fce0e4965ade65a20468a1bfc 2023-11-12 00:55:22,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family1/71bb366c8ac04fe9b6d1822b5af3c215_SeqId_34_ 2023-11-12 00:55:22,103 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-12 00:55:22,105 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 449920aa5f626fab14ce2ff9d43e75d0, NAME => 'ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:22,105 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9743d1cdc651fb2d06c421fbd8ca056c, NAME => 'ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:22,105 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 06e0eec5bf9ea0346eb6e2efb04818c0, NAME => 'ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:22,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-12 00:55:22,350 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-12 00:55:22,406 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family1/a6741566a1654c1faf7d11eba02908b3 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/a6741566a1654c1faf7d11eba02908b3 2023-11-12 00:55:22,411 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 102e79e9eb9e2fd338dca31ed883a20f/family1 of 102e79e9eb9e2fd338dca31ed883a20f into a6741566a1654c1faf7d11eba02908b3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:22,411 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:22,411 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699750521521; duration=0sec 2023-11-12 00:55:22,411 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-12 00:55:22,411 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-12 00:55:22,413 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-12 00:55:22,413 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1912): 102e79e9eb9e2fd338dca31ed883a20f/family2 is initiating minor compaction (all files) 2023-11-12 00:55:22,414 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 102e79e9eb9e2fd338dca31ed883a20f/family2 in testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:55:22,414 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c529a375558f4c678ce4be07f1c9471f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-2e50f32e1b2d4f639da3ea2cd42bc489, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-91cce381f8b547fdbcd271d600847505, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-ada3a60ad9424c099c512d74a686053a] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp, totalSize=20.4 K 2023-11-12 00:55:22,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c529a375558f4c678ce4be07f1c9471f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750502945 2023-11-12 00:55:22,415 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-2e50f32e1b2d4f639da3ea2cd42bc489, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750504759 2023-11-12 00:55:22,415 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-91cce381f8b547fdbcd271d600847505, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750505394 2023-11-12 00:55:22,416 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-ada3a60ad9424c099c512d74a686053a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750507178 2023-11-12 00:55:22,430 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): 102e79e9eb9e2fd338dca31ed883a20f#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-12 00:55:22,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-fef1611765f04a04b70c752a8ae1d605, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c8eb87f8ec604c06b63fd0971e801be7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-453ce9c2bb9846c58663b45e4fa325d5, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-a089a6fd33734e2eaf7fb36e80c2a75a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_] to archive 2023-11-12 00:55:22,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:22,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-fef1611765f04a04b70c752a8ae1d605 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-fef1611765f04a04b70c752a8ae1d605 2023-11-12 00:55:22,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c8eb87f8ec604c06b63fd0971e801be7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c8eb87f8ec604c06b63fd0971e801be7 2023-11-12 00:55:22,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-453ce9c2bb9846c58663b45e4fa325d5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-453ce9c2bb9846c58663b45e4fa325d5 2023-11-12 00:55:22,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-a089a6fd33734e2eaf7fb36e80c2a75a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-a089a6fd33734e2eaf7fb36e80c2a75a 2023-11-12 00:55:22,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family1/d4ca4929f79e4f4984d1cebbe0b2a229_SeqId_34_ 2023-11-12 00:55:22,470 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:55:22,515 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:55:22,516 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bf8639a to 127.0.0.1:60532 2023-11-12 00:55:22,516 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:22,517 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:55:22,517 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d419da6 to 127.0.0.1:60532 2023-11-12 00:55:22,517 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:22,517 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:22,517 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:55:22,517 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 06e0eec5bf9ea0346eb6e2efb04818c0, disabling compactions & flushes 2023-11-12 00:55:22,517 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,517 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,517 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. after waiting 0 ms 2023-11-12 00:55:22,517 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,518 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:22,517 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 449920aa5f626fab14ce2ff9d43e75d0, disabling compactions & flushes 2023-11-12 00:55:22,518 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. after waiting 0 ms 2023-11-12 00:55:22,518 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aaab782 to 127.0.0.1:60532 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:22,518 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 9743d1cdc651fb2d06c421fbd8ca056c, disabling compactions & flushes 2023-11-12 00:55:22,518 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,518 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,519 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,519 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. after waiting 0 ms 2023-11-12 00:55:22,519 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,519 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,519 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:22,519 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,519 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:22,525 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:55:22,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699750522528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750522528"}]},"ts":"1699750522528"} 2023-11-12 00:55:22,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699750522528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750522528"}]},"ts":"1699750522528"} 2023-11-12 00:55:22,528 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699750522528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750522528"}]},"ts":"1699750522528"} 2023-11-12 00:55:22,530 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-12 00:55:22,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:55:22,530 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750522530"}]},"ts":"1699750522530"} 2023-11-12 00:55:22,532 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-12 00:55:22,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9743d1cdc651fb2d06c421fbd8ca056c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=06e0eec5bf9ea0346eb6e2efb04818c0, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=449920aa5f626fab14ce2ff9d43e75d0, ASSIGN}] 2023-11-12 00:55:22,535 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=06e0eec5bf9ea0346eb6e2efb04818c0, ASSIGN 2023-11-12 00:55:22,535 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=449920aa5f626fab14ce2ff9d43e75d0, ASSIGN 2023-11-12 00:55:22,536 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9743d1cdc651fb2d06c421fbd8ca056c, ASSIGN 2023-11-12 00:55:22,536 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=449920aa5f626fab14ce2ff9d43e75d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:22,536 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=06e0eec5bf9ea0346eb6e2efb04818c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:22,536 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9743d1cdc651fb2d06c421fbd8ca056c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:22,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9743d1cdc651fb2d06c421fbd8ca056c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=449920aa5f626fab14ce2ff9d43e75d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,688 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=06e0eec5bf9ea0346eb6e2efb04818c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,689 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699750522688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750522688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750522688"}]},"ts":"1699750522688"} 2023-11-12 00:55:22,689 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699750522688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750522688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750522688"}]},"ts":"1699750522688"} 2023-11-12 00:55:22,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699750522688"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750522688"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750522688"}]},"ts":"1699750522688"} 2023-11-12 00:55:22,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 9743d1cdc651fb2d06c421fbd8ca056c, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:22,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 06e0eec5bf9ea0346eb6e2efb04818c0, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:22,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 449920aa5f626fab14ce2ff9d43e75d0, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:22,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-12 00:55:22,841 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9743d1cdc651fb2d06c421fbd8ca056c, NAME => 'ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.', STARTKEY => '', ENDKEY => '1'} 2023-11-12 00:55:22,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,846 INFO [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,847 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/.tmp/family2/42d38a93aa234aa5bd2390181d82a87d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/42d38a93aa234aa5bd2390181d82a87d 2023-11-12 00:55:22,847 DEBUG [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1 2023-11-12 00:55:22,847 DEBUG [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1 2023-11-12 00:55:22,848 INFO [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9743d1cdc651fb2d06c421fbd8ca056c columnFamilyName family1 2023-11-12 00:55:22,849 INFO [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] regionserver.HStore(310): Store=9743d1cdc651fb2d06c421fbd8ca056c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:22,849 INFO [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,852 DEBUG [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2 2023-11-12 00:55:22,852 DEBUG [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2 2023-11-12 00:55:22,853 INFO [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9743d1cdc651fb2d06c421fbd8ca056c columnFamilyName family2 2023-11-12 00:55:22,853 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 102e79e9eb9e2fd338dca31ed883a20f/family2 of 102e79e9eb9e2fd338dca31ed883a20f into 42d38a93aa234aa5bd2390181d82a87d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:22,853 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:55:22,853 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f., storeName=102e79e9eb9e2fd338dca31ed883a20f/family2, priority=12, startTime=1699750520363; duration=0sec 2023-11-12 00:55:22,853 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-12 00:55:22,853 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-12 00:55:22,853 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-12 00:55:22,853 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-12 00:55:22,853 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. because compaction request was cancelled 2023-11-12 00:55:22,854 INFO [StoreOpener-9743d1cdc651fb2d06c421fbd8ca056c-1] regionserver.HStore(310): Store=9743d1cdc651fb2d06c421fbd8ca056c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:22,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:22,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:55:22,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:22,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9743d1cdc651fb2d06c421fbd8ca056c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60749167, jitterRate=-0.09476687014102936}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:22,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:22,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c., pid=109, masterSystemTime=1699750522841 2023-11-12 00:55:22,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:22,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 449920aa5f626fab14ce2ff9d43e75d0, NAME => 'ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.', STARTKEY => '2', ENDKEY => ''} 2023-11-12 00:55:22,865 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=9743d1cdc651fb2d06c421fbd8ca056c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699750522865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750522865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750522865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750522865"}]},"ts":"1699750522865"} 2023-11-12 00:55:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,866 INFO [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-11-12 00:55:22,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 9743d1cdc651fb2d06c421fbd8ca056c, server=jenkins-hbase4.apache.org,43681,1699750400629 in 176 msec 2023-11-12 00:55:22,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=9743d1cdc651fb2d06c421fbd8ca056c, ASSIGN in 334 msec 2023-11-12 00:55:22,869 DEBUG [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1 2023-11-12 00:55:22,869 DEBUG [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1 2023-11-12 00:55:22,870 INFO [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 449920aa5f626fab14ce2ff9d43e75d0 columnFamilyName family1 2023-11-12 00:55:22,871 INFO [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] regionserver.HStore(310): Store=449920aa5f626fab14ce2ff9d43e75d0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:22,871 INFO [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,872 DEBUG [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2 2023-11-12 00:55:22,872 DEBUG [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2 2023-11-12 00:55:22,872 INFO [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 449920aa5f626fab14ce2ff9d43e75d0 columnFamilyName family2 2023-11-12 00:55:22,873 INFO [StoreOpener-449920aa5f626fab14ce2ff9d43e75d0-1] regionserver.HStore(310): Store=449920aa5f626fab14ce2ff9d43e75d0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:22,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:22,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:55:22,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:22,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 449920aa5f626fab14ce2ff9d43e75d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63132233, jitterRate=-0.0592564195394516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:22,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:22,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0., pid=111, masterSystemTime=1699750522841 2023-11-12 00:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:22,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 06e0eec5bf9ea0346eb6e2efb04818c0, NAME => 'ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.', STARTKEY => '1', ENDKEY => '2'} 2023-11-12 00:55:22,881 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=449920aa5f626fab14ce2ff9d43e75d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:22,881 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699750522881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750522881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750522881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750522881"}]},"ts":"1699750522881"} 2023-11-12 00:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,882 INFO [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,883 DEBUG [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1 2023-11-12 00:55:22,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-11-12 00:55:22,884 DEBUG [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1 2023-11-12 00:55:22,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 449920aa5f626fab14ce2ff9d43e75d0, server=jenkins-hbase4.apache.org,43681,1699750400629 in 191 msec 2023-11-12 00:55:22,884 INFO [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06e0eec5bf9ea0346eb6e2efb04818c0 columnFamilyName family1 2023-11-12 00:55:22,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=449920aa5f626fab14ce2ff9d43e75d0, ASSIGN in 350 msec 2023-11-12 00:55:22,885 INFO [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] regionserver.HStore(310): Store=06e0eec5bf9ea0346eb6e2efb04818c0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:22,885 INFO [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,886 DEBUG [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2 2023-11-12 00:55:22,886 DEBUG [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2 2023-11-12 00:55:22,886 INFO [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06e0eec5bf9ea0346eb6e2efb04818c0 columnFamilyName family2 2023-11-12 00:55:22,887 INFO [StoreOpener-06e0eec5bf9ea0346eb6e2efb04818c0-1] regionserver.HStore(310): Store=06e0eec5bf9ea0346eb6e2efb04818c0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:22,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:22,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:55:22,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:22,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 06e0eec5bf9ea0346eb6e2efb04818c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65084250, jitterRate=-0.03016909956932068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:22,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:22,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0., pid=110, masterSystemTime=1699750522841 2023-11-12 00:55:22,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:22,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=06e0eec5bf9ea0346eb6e2efb04818c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:22,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699750522893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750522893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750522893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750522893"}]},"ts":"1699750522893"} 2023-11-12 00:55:22,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=107 2023-11-12 00:55:22,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 06e0eec5bf9ea0346eb6e2efb04818c0, server=jenkins-hbase4.apache.org,43681,1699750400629 in 204 msec 2023-11-12 00:55:22,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-12 00:55:22,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=06e0eec5bf9ea0346eb6e2efb04818c0, ASSIGN in 362 msec 2023-11-12 00:55:22,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:55:22,897 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750522897"}]},"ts":"1699750522897"} 2023-11-12 00:55:22,898 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-12 00:55:22,900 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:55:22,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2100 sec 2023-11-12 00:55:22,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c529a375558f4c678ce4be07f1c9471f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-2e50f32e1b2d4f639da3ea2cd42bc489, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-91cce381f8b547fdbcd271d600847505, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-ada3a60ad9424c099c512d74a686053a] to archive 2023-11-12 00:55:22,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:22,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c529a375558f4c678ce4be07f1c9471f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-c529a375558f4c678ce4be07f1c9471f 2023-11-12 00:55:22,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-2e50f32e1b2d4f639da3ea2cd42bc489 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-2e50f32e1b2d4f639da3ea2cd42bc489 2023-11-12 00:55:22,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-91cce381f8b547fdbcd271d600847505 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-91cce381f8b547fdbcd271d600847505 2023-11-12 00:55:22,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-ada3a60ad9424c099c512d74a686053a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/family2/testCompactionWithHFileLink=102e79e9eb9e2fd338dca31ed883a20f-ada3a60ad9424c099c512d74a686053a 2023-11-12 00:55:23,236 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/.tmp/family2/2eed3156ff964ed8a5430acd6348668a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/2eed3156ff964ed8a5430acd6348668a 2023-11-12 00:55:23,241 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 5f718172b15982a24b524747297f2bf3/family2 of 5f718172b15982a24b524747297f2bf3 into 2eed3156ff964ed8a5430acd6348668a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:23,241 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:55:23,241 INFO [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3., storeName=5f718172b15982a24b524747297f2bf3/family2, priority=12, startTime=1699750520424; duration=1sec 2023-11-12 00:55:23,241 DEBUG [RS:0;jenkins-hbase4:43681-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:23,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-8d8ed76f1c7d449b9a50e0064607d8f9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-91f30e370a0a40d5a89f897a57239cca, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-1b168663b90841d68a76d0dadf5ec19a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-7a711cfaf51640fa8e9c47039b6399aa] to archive 2023-11-12 00:55:23,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:23,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-8d8ed76f1c7d449b9a50e0064607d8f9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-8d8ed76f1c7d449b9a50e0064607d8f9 2023-11-12 00:55:23,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-91f30e370a0a40d5a89f897a57239cca to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-91f30e370a0a40d5a89f897a57239cca 2023-11-12 00:55:23,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-1b168663b90841d68a76d0dadf5ec19a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-1b168663b90841d68a76d0dadf5ec19a 2023-11-12 00:55:23,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-7a711cfaf51640fa8e9c47039b6399aa to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/family2/testCompactionWithHFileLink=5f718172b15982a24b524747297f2bf3-7a711cfaf51640fa8e9c47039b6399aa 2023-11-12 00:55:23,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-12 00:55:23,798 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-12 00:55:23,804 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:23,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:23,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:23,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:23,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-12 00:55:23,809 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-12 00:55:23,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:23,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-12 00:55:23,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-12 00:55:23,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:23,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:23,812 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:23,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:23,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:23,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:23,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:23,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:23,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:23,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:23,813 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-12 00:55:23,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-12 00:55:23,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-12 00:55:23,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:23,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-12 00:55:23,813 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:23,814 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. started... 2023-11-12 00:55:23,814 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:23,814 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. started... 2023-11-12 00:55:23,816 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:23,818 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:23,818 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9743d1cdc651fb2d06c421fbd8ca056c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:23,818 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:23,818 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06e0eec5bf9ea0346eb6e2efb04818c0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:23,818 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. started... 2023-11-12 00:55:23,818 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 449920aa5f626fab14ce2ff9d43e75d0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:23,837 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311127ad46d73e18b4af49bdba6e21e38a7b1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311127ad46d73e18b4af49bdba6e21e38a7b1 2023-11-12 00:55:23,841 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/077f78db067d4107866ec430da5c0f19 2023-11-12 00:55:24,234 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112f5a54b4b6829470da133afae75388a8f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112f5a54b4b6829470da133afae75388a8f 2023-11-12 00:55:24,239 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111273b05e0e7bac49c4bd6da333690c37f8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111273b05e0e7bac49c4bd6da333690c37f8 2023-11-12 00:55:24,252 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112c7381f43629c4e1f9ab06b1d1307e459 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231112c7381f43629c4e1f9ab06b1d1307e459 2023-11-12 00:55:24,640 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/2ab0a98f5c52449ab036246f83658da9 2023-11-12 00:55:24,643 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/5e8910895f1c41c190512a09974b181c 2023-11-12 00:55:24,653 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311124e8cac9e7b534799a302bd774cf52167 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311124e8cac9e7b534799a302bd774cf52167 2023-11-12 00:55:24,657 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/115dd375f3984c58a74dcd980c9dfed9 2023-11-12 00:55:24,661 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/077f78db067d4107866ec430da5c0f19 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/077f78db067d4107866ec430da5c0f19 2023-11-12 00:55:24,665 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/077f78db067d4107866ec430da5c0f19, entries=4, sequenceid=5, filesize=5.4 K 2023-11-12 00:55:24,666 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/115dd375f3984c58a74dcd980c9dfed9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/115dd375f3984c58a74dcd980c9dfed9 2023-11-12 00:55:24,669 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/115dd375f3984c58a74dcd980c9dfed9, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:24,670 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9743d1cdc651fb2d06c421fbd8ca056c in 852ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:24,670 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-12 00:55:24,671 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:24,671 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:24,671 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:25,060 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112d6cadeea5a1c4ba492fbd72d93227bc6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231112d6cadeea5a1c4ba492fbd72d93227bc6 2023-11-12 00:55:25,062 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/323157c940744e31814ab63d21967b07 2023-11-12 00:55:25,067 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/2ab0a98f5c52449ab036246f83658da9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2ab0a98f5c52449ab036246f83658da9 2023-11-12 00:55:25,070 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2ab0a98f5c52449ab036246f83658da9, entries=4, sequenceid=5, filesize=5.4 K 2023-11-12 00:55:25,071 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/323157c940744e31814ab63d21967b07 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/323157c940744e31814ab63d21967b07 2023-11-12 00:55:25,074 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/323157c940744e31814ab63d21967b07, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:25,075 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 06e0eec5bf9ea0346eb6e2efb04818c0 in 1257ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:25,076 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:25,076 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:25,076 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:25,466 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/51e18b460d294b40b2a05b267a22d602 2023-11-12 00:55:25,470 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/5e8910895f1c41c190512a09974b181c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/5e8910895f1c41c190512a09974b181c 2023-11-12 00:55:25,473 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/5e8910895f1c41c190512a09974b181c, entries=4, sequenceid=5, filesize=5.4 K 2023-11-12 00:55:25,474 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/51e18b460d294b40b2a05b267a22d602 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/51e18b460d294b40b2a05b267a22d602 2023-11-12 00:55:25,477 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/51e18b460d294b40b2a05b267a22d602, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:25,478 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 449920aa5f626fab14ce2ff9d43e75d0 in 1660ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:25,478 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:25,478 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-12 00:55:25,478 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-12 00:55:25,480 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,480 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:25,480 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,480 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:25,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-12 00:55:25,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f844df3[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:25,481 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-12 00:55:25,481 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,482 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,483 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-12 00:55:25,483 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-12 00:55:25,483 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,483 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:25,483 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:25,484 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-12 00:55:25,484 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,484 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:25,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:25,484 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-12 00:55:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:25,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:25,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:25,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-12 00:55:25,487 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-12 00:55:25,487 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:25,487 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:25,487 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-12 00:55:25,487 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:25,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,490 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:25,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:25,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:25,490 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:25,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:25,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:25,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,492 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:25,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:25,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,494 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:25,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-12 00:55:25,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-12 00:55:25,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:25,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:25,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,494 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:25,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:25,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:25,495 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:25,595 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:25,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:25,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:25,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:25,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:25,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:25,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:25,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-12 00:55:25,601 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-12 00:55:25,601 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:25,601 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-12 00:55:25,601 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-12 00:55:25,601 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,601 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:25,603 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,603 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:25,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:25,603 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:25,603 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:25,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:25,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:25,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:25,604 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-12 00:55:25,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-12 00:55:25,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-12 00:55:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-12 00:55:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:25,604 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-12 00:55:25,604 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:25,605 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. started... 2023-11-12 00:55:25,605 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:25,605 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. started... 2023-11-12 00:55:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:25,605 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:25,605 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06e0eec5bf9ea0346eb6e2efb04818c0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:25,605 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9743d1cdc651fb2d06c421fbd8ca056c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:25,605 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:25,605 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. started... 2023-11-12 00:55:25,605 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 449920aa5f626fab14ce2ff9d43e75d0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:26,024 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112100b768b9d1b4d18a82c87e05cd9ec75 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231112100b768b9d1b4d18a82c87e05cd9ec75 2023-11-12 00:55:26,024 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112f5b589e7edef47d6be33dbb6121327cb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112f5b589e7edef47d6be33dbb6121327cb 2023-11-12 00:55:26,025 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111241a5d079dcd5457cbc5a84a9cec0f47a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111241a5d079dcd5457cbc5a84a9cec0f47a 2023-11-12 00:55:26,435 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/8e5930d6ddb646c9b6b17fad62d01a03 2023-11-12 00:55:26,439 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/70d997b7382c4e07ac1b9cd11494cdf1 2023-11-12 00:55:26,439 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/440056d6808142f1932abb2a56887d05 2023-11-12 00:55:26,849 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112d04e989dc6d8472b878b783580a19a5a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231112d04e989dc6d8472b878b783580a19a5a 2023-11-12 00:55:26,854 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/1366b5c830264d44930b9f58c6f8d3d6 2023-11-12 00:55:26,858 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/8e5930d6ddb646c9b6b17fad62d01a03 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/8e5930d6ddb646c9b6b17fad62d01a03 2023-11-12 00:55:26,860 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111262ded375d74e4592bf702309d143d822 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111262ded375d74e4592bf702309d143d822 2023-11-12 00:55:26,860 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111202ff0ed8a6724ccd95c60d3b0f84e7bf to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111202ff0ed8a6724ccd95c60d3b0f84e7bf 2023-11-12 00:55:26,862 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/8e5930d6ddb646c9b6b17fad62d01a03, entries=4, sequenceid=9, filesize=5.4 K 2023-11-12 00:55:26,863 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/1366b5c830264d44930b9f58c6f8d3d6 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/1366b5c830264d44930b9f58c6f8d3d6 2023-11-12 00:55:26,867 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/1366b5c830264d44930b9f58c6f8d3d6, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:26,868 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 06e0eec5bf9ea0346eb6e2efb04818c0 in 1263ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:26,868 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:26,868 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:26,868 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:27,265 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/00e2eec250b94fea9a37467cb73614fc 2023-11-12 00:55:27,265 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/247bcf4cb4764d1f8766a1333677b684 2023-11-12 00:55:27,269 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/70d997b7382c4e07ac1b9cd11494cdf1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/70d997b7382c4e07ac1b9cd11494cdf1 2023-11-12 00:55:27,269 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/440056d6808142f1932abb2a56887d05 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/440056d6808142f1932abb2a56887d05 2023-11-12 00:55:27,273 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/70d997b7382c4e07ac1b9cd11494cdf1, entries=4, sequenceid=9, filesize=5.4 K 2023-11-12 00:55:27,273 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/440056d6808142f1932abb2a56887d05, entries=4, sequenceid=9, filesize=5.4 K 2023-11-12 00:55:27,274 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/247bcf4cb4764d1f8766a1333677b684 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/247bcf4cb4764d1f8766a1333677b684 2023-11-12 00:55:27,274 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/00e2eec250b94fea9a37467cb73614fc as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/00e2eec250b94fea9a37467cb73614fc 2023-11-12 00:55:27,278 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/00e2eec250b94fea9a37467cb73614fc, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:27,278 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/247bcf4cb4764d1f8766a1333677b684, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:27,278 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9743d1cdc651fb2d06c421fbd8ca056c in 1673ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:27,278 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 449920aa5f626fab14ce2ff9d43e75d0 in 1673ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:27,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:27,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:27,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:27,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-12 00:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-12 00:55:27,280 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,280 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:27,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:27,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-12 00:55:27,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23954d52[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:27,283 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-12 00:55:27,283 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,285 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,286 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-12 00:55:27,286 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-12 00:55:27,286 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:27,286 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,286 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:27,287 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,287 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-12 00:55:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:27,287 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:27,287 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-12 00:55:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:27,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:27,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-12 00:55:27,290 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-12 00:55:27,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:27,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:27,290 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-12 00:55:27,290 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:27,292 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,292 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:27,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,292 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:27,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:27,292 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:27,294 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:27,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:27,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:27,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:27,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-12 00:55:27,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-12 00:55:27,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:27,296 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:27,296 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:27,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:27,297 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,297 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,297 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:27,297 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,297 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:27,297 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:27,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:27,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:27,397 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:27,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:27,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:27,400 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:27,400 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:27,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:27,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:27,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-12 00:55:27,403 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-12 00:55:27,404 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:27,404 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-12 00:55:27,404 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-12 00:55:27,404 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,404 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:27,406 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,406 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:27,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:27,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:27,406 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:27,407 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:27,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:27,407 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-12 00:55:27,408 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-12 00:55:27,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-12 00:55:27,408 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-12 00:55:27,408 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:27,408 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-12 00:55:27,408 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:27,408 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. started... 2023-11-12 00:55:27,408 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:27,408 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:27,408 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. started... 2023-11-12 00:55:27,408 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:27,408 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 449920aa5f626fab14ce2ff9d43e75d0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:27,408 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. started... 2023-11-12 00:55:27,408 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06e0eec5bf9ea0346eb6e2efb04818c0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:27,408 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:27,409 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9743d1cdc651fb2d06c421fbd8ca056c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:27,830 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311121be7818da6be48c98ea7df46a1b58c61 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311121be7818da6be48c98ea7df46a1b58c61 2023-11-12 00:55:27,830 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111208274c2deb5b4cf390efc8a48bfb37cb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111208274c2deb5b4cf390efc8a48bfb37cb 2023-11-12 00:55:27,830 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311124e1674a587e54283a233a9ff90326a41 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311124e1674a587e54283a233a9ff90326a41 2023-11-12 00:55:27,844 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/099e66374ca548118a33466ced0c42b9 2023-11-12 00:55:27,857 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111242da59d3ae1c4c64b0167c2654653f9c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023111242da59d3ae1c4c64b0167c2654653f9c 2023-11-12 00:55:27,861 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/46f74f90c0c74d4ab905dc23124b0920 2023-11-12 00:55:27,864 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/099e66374ca548118a33466ced0c42b9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/099e66374ca548118a33466ced0c42b9 2023-11-12 00:55:27,867 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/099e66374ca548118a33466ced0c42b9, entries=4, sequenceid=13, filesize=5.4 K 2023-11-12 00:55:27,868 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/46f74f90c0c74d4ab905dc23124b0920 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/46f74f90c0c74d4ab905dc23124b0920 2023-11-12 00:55:27,871 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/46f74f90c0c74d4ab905dc23124b0920, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:27,872 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 449920aa5f626fab14ce2ff9d43e75d0 in 464ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:27,872 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:27,872 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:27,872 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:28,243 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/cfb4c612348c4874816aec337dd9cb65 2023-11-12 00:55:28,244 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/79fe9cd8e59e4a9fb4bad895470bf9b7 2023-11-12 00:55:28,346 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:55:28,657 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311121b1a62b259a64b7faf407c0334b9b0da to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311121b1a62b259a64b7faf407c0334b9b0da 2023-11-12 00:55:28,657 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311127607ebb03ef844cf87596378521aaded to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311127607ebb03ef844cf87596378521aaded 2023-11-12 00:55:29,062 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/89b43814b64a41e58e4ccaac26b64a1e 2023-11-12 00:55:29,062 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/30f10e5ce2ca49b2a91719ea78d7c2fa 2023-11-12 00:55:29,067 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/cfb4c612348c4874816aec337dd9cb65 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/cfb4c612348c4874816aec337dd9cb65 2023-11-12 00:55:29,068 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/79fe9cd8e59e4a9fb4bad895470bf9b7 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79fe9cd8e59e4a9fb4bad895470bf9b7 2023-11-12 00:55:29,072 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/cfb4c612348c4874816aec337dd9cb65, entries=4, sequenceid=13, filesize=5.4 K 2023-11-12 00:55:29,072 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79fe9cd8e59e4a9fb4bad895470bf9b7, entries=4, sequenceid=13, filesize=5.4 K 2023-11-12 00:55:29,072 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/89b43814b64a41e58e4ccaac26b64a1e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/89b43814b64a41e58e4ccaac26b64a1e 2023-11-12 00:55:29,072 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/30f10e5ce2ca49b2a91719ea78d7c2fa as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/30f10e5ce2ca49b2a91719ea78d7c2fa 2023-11-12 00:55:29,076 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/89b43814b64a41e58e4ccaac26b64a1e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:29,076 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/30f10e5ce2ca49b2a91719ea78d7c2fa, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:29,077 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 06e0eec5bf9ea0346eb6e2efb04818c0 in 1669ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:29,077 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9743d1cdc651fb2d06c421fbd8ca056c in 1668ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:29,077 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:29,077 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:29,077 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:29,077 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:29,077 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:29,077 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:29,077 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:29,077 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,077 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-12 00:55:29,077 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-12 00:55:29,079 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:29,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,079 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:29,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:29,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-12 00:55:29,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37f6874d[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:29,080 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-12 00:55:29,081 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,082 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,082 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-12 00:55:29,082 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-12 00:55:29,082 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:29,082 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,082 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-12 00:55:29,083 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:29,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:29,083 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-12 00:55:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:29,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:29,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:29,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-12 00:55:29,086 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-12 00:55:29,086 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:29,086 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:29,086 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-12 00:55:29,086 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:29,095 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,095 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:29,095 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:29,096 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:29,097 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,099 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:29,099 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,099 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:29,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-12 00:55:29,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:29,099 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:29,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-12 00:55:29,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:29,099 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:29,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,100 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:29,200 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:29,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:29,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:29,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:29,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:29,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:29,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:29,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-12 00:55:29,206 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-12 00:55:29,206 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:29,206 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-12 00:55:29,206 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-12 00:55:29,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,207 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:29,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,208 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:29,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:29,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:29,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:29,208 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:29,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:29,209 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-12 00:55:29,209 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-12 00:55:29,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-12 00:55:29,209 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-12 00:55:29,209 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:29,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-12 00:55:29,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:29,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. started... 2023-11-12 00:55:29,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:29,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. started... 2023-11-12 00:55:29,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:29,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:29,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:29,210 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06e0eec5bf9ea0346eb6e2efb04818c0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:29,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. started... 2023-11-12 00:55:29,210 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9743d1cdc651fb2d06c421fbd8ca056c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:29,210 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 449920aa5f626fab14ce2ff9d43e75d0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:29,623 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111232f6657d53634cf58af55f47e976f82b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111232f6657d53634cf58af55f47e976f82b 2023-11-12 00:55:29,623 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112b49ea3d588d24b948ff05db6bad602e8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112b49ea3d588d24b948ff05db6bad602e8 2023-11-12 00:55:29,623 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111251b135fc55584c3fb9513f63f1d8b632 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111251b135fc55584c3fb9513f63f1d8b632 2023-11-12 00:55:30,029 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/6037ebff9b314a3d82c34372cc1d5220 2023-11-12 00:55:30,029 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/fa978f4b19ed42879494f2816297e94c 2023-11-12 00:55:30,029 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/3e25bc06dfb749e195e3e0a13b63da5c 2023-11-12 00:55:30,046 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112f89c6d242e544c04acad30035d9a0b4f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231112f89c6d242e544c04acad30035d9a0b4f 2023-11-12 00:55:30,049 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/34cbc186132b4370a9d0e5a532537663 2023-11-12 00:55:30,053 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/6037ebff9b314a3d82c34372cc1d5220 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/6037ebff9b314a3d82c34372cc1d5220 2023-11-12 00:55:30,056 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/6037ebff9b314a3d82c34372cc1d5220, entries=4, sequenceid=17, filesize=5.4 K 2023-11-12 00:55:30,057 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/34cbc186132b4370a9d0e5a532537663 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/34cbc186132b4370a9d0e5a532537663 2023-11-12 00:55:30,060 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/34cbc186132b4370a9d0e5a532537663, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:55:30,061 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 06e0eec5bf9ea0346eb6e2efb04818c0 in 851ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:30,061 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:30,061 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:30,062 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:30,446 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112adeed84da0f943e8b66cb5518b0e97a1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231112adeed84da0f943e8b66cb5518b0e97a1 2023-11-12 00:55:30,458 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111234f4e51dac42420e91e891ab2f5f2519 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111234f4e51dac42420e91e891ab2f5f2519 2023-11-12 00:55:30,851 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/dd49fbc9d3924063b008c2a238d2f5ff 2023-11-12 00:55:30,856 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/fa978f4b19ed42879494f2816297e94c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/fa978f4b19ed42879494f2816297e94c 2023-11-12 00:55:30,859 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/fa978f4b19ed42879494f2816297e94c, entries=4, sequenceid=17, filesize=5.4 K 2023-11-12 00:55:30,860 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/dd49fbc9d3924063b008c2a238d2f5ff as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/dd49fbc9d3924063b008c2a238d2f5ff 2023-11-12 00:55:30,863 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/df32e647cedc43c3944c81125dd711b2 2023-11-12 00:55:30,863 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/dd49fbc9d3924063b008c2a238d2f5ff, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:55:30,864 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 449920aa5f626fab14ce2ff9d43e75d0 in 1654ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:30,864 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:30,864 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:30,864 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:30,867 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/3e25bc06dfb749e195e3e0a13b63da5c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/3e25bc06dfb749e195e3e0a13b63da5c 2023-11-12 00:55:30,870 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/3e25bc06dfb749e195e3e0a13b63da5c, entries=4, sequenceid=17, filesize=5.4 K 2023-11-12 00:55:30,870 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/df32e647cedc43c3944c81125dd711b2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/df32e647cedc43c3944c81125dd711b2 2023-11-12 00:55:30,874 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/df32e647cedc43c3944c81125dd711b2, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:55:30,874 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9743d1cdc651fb2d06c421fbd8ca056c in 1664ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:30,874 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:30,874 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:30,874 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:30,875 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:30,875 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,875 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-12 00:55:30,875 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-12 00:55:30,876 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,876 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:30,877 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:30,877 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-12 00:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35de2d19[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:30,878 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-12 00:55:30,878 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,881 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-12 00:55:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-12 00:55:30,881 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,881 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:30,882 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-12 00:55:30,882 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,882 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:30,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:30,882 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-12 00:55:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:30,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:30,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-12 00:55:30,885 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-12 00:55:30,885 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:30,885 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:30,885 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-12 00:55:30,885 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:30,887 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,887 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:30,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,887 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:30,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:30,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:30,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:30,888 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,889 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:30,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:30,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:30,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:30,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,892 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:30,892 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:30,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-12 00:55:30,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:30,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:30,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:30,893 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:30,893 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:30,893 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:30,993 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:30,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:31,003 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:31,012 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:31,019 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:31,020 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:31,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:31,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:31,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-12 00:55:31,049 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-12 00:55:31,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:31,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-12 00:55:31,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-12 00:55:31,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:31,049 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:31,052 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:31,052 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:31,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:31,052 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:31,052 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:31,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:31,053 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-12 00:55:31,053 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-12 00:55:31,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-12 00:55:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-12 00:55:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-12 00:55:31,054 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:31,054 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:31,054 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:31,054 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. started... 2023-11-12 00:55:31,054 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. started... 2023-11-12 00:55:31,054 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. started... 2023-11-12 00:55:31,054 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 449920aa5f626fab14ce2ff9d43e75d0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:55:31,054 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06e0eec5bf9ea0346eb6e2efb04818c0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:55:31,054 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9743d1cdc651fb2d06c421fbd8ca056c 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:55:31,071 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43 2023-11-12 00:55:31,074 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f3b4d6d4fe441ac9d5b55626bdf7f43 2023-11-12 00:55:31,470 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/79c44d196d7641489aef5eb51f1fd2b2 2023-11-12 00:55:31,474 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79c44d196d7641489aef5eb51f1fd2b2 2023-11-12 00:55:31,868 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/58ddf263d90147eab0d9fc8e70ea0d55 2023-11-12 00:55:31,871 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58ddf263d90147eab0d9fc8e70ea0d55 2023-11-12 00:55:31,891 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/87f8785c00024f6a9f47f2f13c41994a 2023-11-12 00:55:31,894 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87f8785c00024f6a9f47f2f13c41994a 2023-11-12 00:55:31,895 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43 2023-11-12 00:55:31,897 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f3b4d6d4fe441ac9d5b55626bdf7f43 2023-11-12 00:55:31,898 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43, entries=3, sequenceid=23, filesize=5.0 K 2023-11-12 00:55:31,898 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/87f8785c00024f6a9f47f2f13c41994a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/87f8785c00024f6a9f47f2f13c41994a 2023-11-12 00:55:31,901 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87f8785c00024f6a9f47f2f13c41994a 2023-11-12 00:55:31,901 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/87f8785c00024f6a9f47f2f13c41994a, entries=1, sequenceid=23, filesize=5.0 K 2023-11-12 00:55:31,902 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 06e0eec5bf9ea0346eb6e2efb04818c0 in 848ms, sequenceid=23, compaction requested=true 2023-11-12 00:55:31,902 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:31,902 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:31,902 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:32,285 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/f617e5eec3c744fd8208644b511dd1f0 2023-11-12 00:55:32,289 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f617e5eec3c744fd8208644b511dd1f0 2023-11-12 00:55:32,290 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/79c44d196d7641489aef5eb51f1fd2b2 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79c44d196d7641489aef5eb51f1fd2b2 2023-11-12 00:55:32,293 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 79c44d196d7641489aef5eb51f1fd2b2 2023-11-12 00:55:32,293 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79c44d196d7641489aef5eb51f1fd2b2, entries=3, sequenceid=23, filesize=5.0 K 2023-11-12 00:55:32,294 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/f617e5eec3c744fd8208644b511dd1f0 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/f617e5eec3c744fd8208644b511dd1f0 2023-11-12 00:55:32,298 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f617e5eec3c744fd8208644b511dd1f0 2023-11-12 00:55:32,298 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/f617e5eec3c744fd8208644b511dd1f0, entries=1, sequenceid=23, filesize=5.0 K 2023-11-12 00:55:32,299 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9743d1cdc651fb2d06c421fbd8ca056c in 1245ms, sequenceid=23, compaction requested=true 2023-11-12 00:55:32,299 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:32,299 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:32,683 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/359f5a18dea04b72ab43fcc0bc7ed227 2023-11-12 00:55:32,687 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 359f5a18dea04b72ab43fcc0bc7ed227 2023-11-12 00:55:32,687 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/58ddf263d90147eab0d9fc8e70ea0d55 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/58ddf263d90147eab0d9fc8e70ea0d55 2023-11-12 00:55:32,690 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58ddf263d90147eab0d9fc8e70ea0d55 2023-11-12 00:55:32,691 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/58ddf263d90147eab0d9fc8e70ea0d55, entries=3, sequenceid=23, filesize=5.0 K 2023-11-12 00:55:32,691 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/359f5a18dea04b72ab43fcc0bc7ed227 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/359f5a18dea04b72ab43fcc0bc7ed227 2023-11-12 00:55:32,694 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 359f5a18dea04b72ab43fcc0bc7ed227 2023-11-12 00:55:32,695 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/359f5a18dea04b72ab43fcc0bc7ed227, entries=1, sequenceid=23, filesize=5.0 K 2023-11-12 00:55:32,695 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 449920aa5f626fab14ce2ff9d43e75d0 in 1641ms, sequenceid=23, compaction requested=true 2023-11-12 00:55:32,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:32,695 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:32,695 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:32,696 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,696 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-12 00:55:32,696 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-12 00:55:32,697 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,697 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:32,697 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,698 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:32,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:32,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-12 00:55:32,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8081584[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:32,699 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-12 00:55:32,699 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,700 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,700 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-12 00:55:32,701 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-12 00:55:32,701 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:32,701 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,701 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:32,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-12 00:55:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:32,702 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-12 00:55:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:32,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:32,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-12 00:55:32,705 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-12 00:55:32,705 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:32,705 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:32,705 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-12 00:55:32,705 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:32,708 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,708 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:32,708 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:32,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:32,709 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,710 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-12 00:55:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-12 00:55:32,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-12 00:55:32,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:32,713 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-12 00:55:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:32,713 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:32,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:32,813 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:32,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:32,814 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:32,815 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 06e0eec5bf9ea0346eb6e2efb04818c0/family1 is initiating major compaction (all files) 2023-11-12 00:55:32,815 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:32,815 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:32,815 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 06e0eec5bf9ea0346eb6e2efb04818c0/family1 in ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:32,815 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2ab0a98f5c52449ab036246f83658da9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/8e5930d6ddb646c9b6b17fad62d01a03, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/cfb4c612348c4874816aec337dd9cb65, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/6037ebff9b314a3d82c34372cc1d5220, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp, totalSize=26.6 K 2023-11-12 00:55:32,816 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 2ab0a98f5c52449ab036246f83658da9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750523805 2023-11-12 00:55:32,816 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 8e5930d6ddb646c9b6b17fad62d01a03, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750525597 2023-11-12 00:55:32,816 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting cfb4c612348c4874816aec337dd9cb65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750527400 2023-11-12 00:55:32,817 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 6037ebff9b314a3d82c34372cc1d5220, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750529202 2023-11-12 00:55:32,817 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 0f3b4d6d4fe441ac9d5b55626bdf7f43, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:55:32,826 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 06e0eec5bf9ea0346eb6e2efb04818c0#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:33,234 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112409d385d4e71405aaed7bfd786f40aed_del 2023-11-12 00:55:33,234 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112409d385d4e71405aaed7bfd786f40aed_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112409d385d4e71405aaed7bfd786f40aed_del 2023-11-12 00:55:34,046 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5389eb94371e4fee9483f2594b2425f9 2023-11-12 00:55:34,047 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family1/5389eb94371e4fee9483f2594b2425f9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/5389eb94371e4fee9483f2594b2425f9 2023-11-12 00:55:34,050 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5389eb94371e4fee9483f2594b2425f9 2023-11-12 00:55:34,051 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 06e0eec5bf9ea0346eb6e2efb04818c0/family1 of 06e0eec5bf9ea0346eb6e2efb04818c0 into 5389eb94371e4fee9483f2594b2425f9(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:34,051 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:34,051 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:34,051 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 06e0eec5bf9ea0346eb6e2efb04818c0/family2 is initiating major compaction (all files) 2023-11-12 00:55:34,051 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:34,051 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:34,051 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 06e0eec5bf9ea0346eb6e2efb04818c0/family2 in ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:55:34,051 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/323157c940744e31814ab63d21967b07, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/1366b5c830264d44930b9f58c6f8d3d6, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/89b43814b64a41e58e4ccaac26b64a1e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/34cbc186132b4370a9d0e5a532537663, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/87f8785c00024f6a9f47f2f13c41994a] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp, totalSize=25.3 K 2023-11-12 00:55:34,052 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 323157c940744e31814ab63d21967b07, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750523805 2023-11-12 00:55:34,053 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 1366b5c830264d44930b9f58c6f8d3d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750525597 2023-11-12 00:55:34,053 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 89b43814b64a41e58e4ccaac26b64a1e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750527400 2023-11-12 00:55:34,053 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 34cbc186132b4370a9d0e5a532537663, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750529202 2023-11-12 00:55:34,054 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 87f8785c00024f6a9f47f2f13c41994a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:55:34,061 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 06e0eec5bf9ea0346eb6e2efb04818c0#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:34,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2ab0a98f5c52449ab036246f83658da9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/8e5930d6ddb646c9b6b17fad62d01a03, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/cfb4c612348c4874816aec337dd9cb65, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/6037ebff9b314a3d82c34372cc1d5220, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43] to archive 2023-11-12 00:55:34,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:34,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2ab0a98f5c52449ab036246f83658da9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2ab0a98f5c52449ab036246f83658da9 2023-11-12 00:55:34,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/8e5930d6ddb646c9b6b17fad62d01a03 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/8e5930d6ddb646c9b6b17fad62d01a03 2023-11-12 00:55:34,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/cfb4c612348c4874816aec337dd9cb65 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/cfb4c612348c4874816aec337dd9cb65 2023-11-12 00:55:34,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/6037ebff9b314a3d82c34372cc1d5220 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/6037ebff9b314a3d82c34372cc1d5220 2023-11-12 00:55:34,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/0f3b4d6d4fe441ac9d5b55626bdf7f43 2023-11-12 00:55:34,470 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112db4a36fd6c7a4e75bed03a19a6121c92_del 2023-11-12 00:55:34,471 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112db4a36fd6c7a4e75bed03a19a6121c92_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231112db4a36fd6c7a4e75bed03a19a6121c92_del 2023-11-12 00:55:35,284 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a33dc65d44a743f8ad5ef9f75e774223 2023-11-12 00:55:35,284 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/.tmp/family2/a33dc65d44a743f8ad5ef9f75e774223 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/a33dc65d44a743f8ad5ef9f75e774223 2023-11-12 00:55:35,288 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a33dc65d44a743f8ad5ef9f75e774223 2023-11-12 00:55:35,289 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 06e0eec5bf9ea0346eb6e2efb04818c0/family2 of 06e0eec5bf9ea0346eb6e2efb04818c0 into a33dc65d44a743f8ad5ef9f75e774223(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:35,289 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:35,289 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:35,289 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 9743d1cdc651fb2d06c421fbd8ca056c/family1 is initiating major compaction (all files) 2023-11-12 00:55:35,289 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:35,289 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:35,290 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 9743d1cdc651fb2d06c421fbd8ca056c/family1 in ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:35,290 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/077f78db067d4107866ec430da5c0f19, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/440056d6808142f1932abb2a56887d05, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79fe9cd8e59e4a9fb4bad895470bf9b7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/3e25bc06dfb749e195e3e0a13b63da5c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79c44d196d7641489aef5eb51f1fd2b2] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp, totalSize=26.6 K 2023-11-12 00:55:35,290 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 077f78db067d4107866ec430da5c0f19, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750523804 2023-11-12 00:55:35,290 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 440056d6808142f1932abb2a56887d05, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750525597 2023-11-12 00:55:35,291 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 79fe9cd8e59e4a9fb4bad895470bf9b7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750527399 2023-11-12 00:55:35,291 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 3e25bc06dfb749e195e3e0a13b63da5c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750529202 2023-11-12 00:55:35,291 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 79c44d196d7641489aef5eb51f1fd2b2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:55:35,306 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 9743d1cdc651fb2d06c421fbd8ca056c#family1#compaction#152 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:35,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/323157c940744e31814ab63d21967b07, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/1366b5c830264d44930b9f58c6f8d3d6, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/89b43814b64a41e58e4ccaac26b64a1e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/34cbc186132b4370a9d0e5a532537663, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/87f8785c00024f6a9f47f2f13c41994a] to archive 2023-11-12 00:55:35,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:35,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/323157c940744e31814ab63d21967b07 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/323157c940744e31814ab63d21967b07 2023-11-12 00:55:35,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/1366b5c830264d44930b9f58c6f8d3d6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/1366b5c830264d44930b9f58c6f8d3d6 2023-11-12 00:55:35,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/89b43814b64a41e58e4ccaac26b64a1e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/89b43814b64a41e58e4ccaac26b64a1e 2023-11-12 00:55:35,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/34cbc186132b4370a9d0e5a532537663 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/34cbc186132b4370a9d0e5a532537663 2023-11-12 00:55:35,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/87f8785c00024f6a9f47f2f13c41994a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family2/87f8785c00024f6a9f47f2f13c41994a 2023-11-12 00:55:35,714 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311124bd980e08f0f4100a94d24ca27d9a9a2_del 2023-11-12 00:55:35,715 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311124bd980e08f0f4100a94d24ca27d9a9a2_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311124bd980e08f0f4100a94d24ca27d9a9a2_del 2023-11-12 00:55:36,528 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 655997325ed54e23b362e7d0e1e8d244 2023-11-12 00:55:36,528 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family1/655997325ed54e23b362e7d0e1e8d244 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/655997325ed54e23b362e7d0e1e8d244 2023-11-12 00:55:36,532 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 655997325ed54e23b362e7d0e1e8d244 2023-11-12 00:55:36,532 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9743d1cdc651fb2d06c421fbd8ca056c/family1 of 9743d1cdc651fb2d06c421fbd8ca056c into 655997325ed54e23b362e7d0e1e8d244(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:36,532 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:36,533 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:36,533 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 9743d1cdc651fb2d06c421fbd8ca056c/family2 is initiating major compaction (all files) 2023-11-12 00:55:36,533 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:36,533 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:36,533 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 9743d1cdc651fb2d06c421fbd8ca056c/family2 in ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:55:36,533 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/115dd375f3984c58a74dcd980c9dfed9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/00e2eec250b94fea9a37467cb73614fc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/30f10e5ce2ca49b2a91719ea78d7c2fa, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/df32e647cedc43c3944c81125dd711b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/f617e5eec3c744fd8208644b511dd1f0] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp, totalSize=25.3 K 2023-11-12 00:55:36,533 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 115dd375f3984c58a74dcd980c9dfed9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750523804 2023-11-12 00:55:36,534 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 00e2eec250b94fea9a37467cb73614fc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750525597 2023-11-12 00:55:36,534 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 30f10e5ce2ca49b2a91719ea78d7c2fa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750527399 2023-11-12 00:55:36,534 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting df32e647cedc43c3944c81125dd711b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750529202 2023-11-12 00:55:36,534 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting f617e5eec3c744fd8208644b511dd1f0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:55:36,544 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 9743d1cdc651fb2d06c421fbd8ca056c#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:36,555 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311127d7db2cc448941fb9ef305cc295b2571_del 2023-11-12 00:55:36,555 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311127d7db2cc448941fb9ef305cc295b2571_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311127d7db2cc448941fb9ef305cc295b2571_del 2023-11-12 00:55:36,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/077f78db067d4107866ec430da5c0f19, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/440056d6808142f1932abb2a56887d05, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79fe9cd8e59e4a9fb4bad895470bf9b7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/3e25bc06dfb749e195e3e0a13b63da5c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79c44d196d7641489aef5eb51f1fd2b2] to archive 2023-11-12 00:55:36,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:36,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/077f78db067d4107866ec430da5c0f19 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/077f78db067d4107866ec430da5c0f19 2023-11-12 00:55:36,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/440056d6808142f1932abb2a56887d05 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/440056d6808142f1932abb2a56887d05 2023-11-12 00:55:36,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79fe9cd8e59e4a9fb4bad895470bf9b7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79fe9cd8e59e4a9fb4bad895470bf9b7 2023-11-12 00:55:36,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/3e25bc06dfb749e195e3e0a13b63da5c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/3e25bc06dfb749e195e3e0a13b63da5c 2023-11-12 00:55:36,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79c44d196d7641489aef5eb51f1fd2b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/79c44d196d7641489aef5eb51f1fd2b2 2023-11-12 00:55:37,368 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca7bd454fa084c809cde96f4495268c5 2023-11-12 00:55:37,369 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/.tmp/family2/ca7bd454fa084c809cde96f4495268c5 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/ca7bd454fa084c809cde96f4495268c5 2023-11-12 00:55:37,372 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca7bd454fa084c809cde96f4495268c5 2023-11-12 00:55:37,373 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9743d1cdc651fb2d06c421fbd8ca056c/family2 of 9743d1cdc651fb2d06c421fbd8ca056c into ca7bd454fa084c809cde96f4495268c5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:37,374 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:37,374 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:37,374 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 449920aa5f626fab14ce2ff9d43e75d0/family1 is initiating major compaction (all files) 2023-11-12 00:55:37,374 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:37,374 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:37,374 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 449920aa5f626fab14ce2ff9d43e75d0/family1 in ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:37,374 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/5e8910895f1c41c190512a09974b181c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/70d997b7382c4e07ac1b9cd11494cdf1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/099e66374ca548118a33466ced0c42b9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/fa978f4b19ed42879494f2816297e94c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/58ddf263d90147eab0d9fc8e70ea0d55] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp, totalSize=26.6 K 2023-11-12 00:55:37,374 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 5e8910895f1c41c190512a09974b181c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750523805 2023-11-12 00:55:37,375 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 70d997b7382c4e07ac1b9cd11494cdf1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750525597 2023-11-12 00:55:37,375 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 099e66374ca548118a33466ced0c42b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750527400 2023-11-12 00:55:37,376 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting fa978f4b19ed42879494f2816297e94c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750529202 2023-11-12 00:55:37,376 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 58ddf263d90147eab0d9fc8e70ea0d55, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:55:37,383 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 449920aa5f626fab14ce2ff9d43e75d0#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:37,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/115dd375f3984c58a74dcd980c9dfed9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/00e2eec250b94fea9a37467cb73614fc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/30f10e5ce2ca49b2a91719ea78d7c2fa, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/df32e647cedc43c3944c81125dd711b2, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/f617e5eec3c744fd8208644b511dd1f0] to archive 2023-11-12 00:55:37,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:37,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/115dd375f3984c58a74dcd980c9dfed9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/115dd375f3984c58a74dcd980c9dfed9 2023-11-12 00:55:37,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/00e2eec250b94fea9a37467cb73614fc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/00e2eec250b94fea9a37467cb73614fc 2023-11-12 00:55:37,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/30f10e5ce2ca49b2a91719ea78d7c2fa to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/30f10e5ce2ca49b2a91719ea78d7c2fa 2023-11-12 00:55:37,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/df32e647cedc43c3944c81125dd711b2 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/df32e647cedc43c3944c81125dd711b2 2023-11-12 00:55:37,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/f617e5eec3c744fd8208644b511dd1f0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family2/f617e5eec3c744fd8208644b511dd1f0 2023-11-12 00:55:37,791 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231112a4ea9913d2c046d0a93200cbcf8e09a1_del 2023-11-12 00:55:37,792 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112a4ea9913d2c046d0a93200cbcf8e09a1_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231112a4ea9913d2c046d0a93200cbcf8e09a1_del 2023-11-12 00:55:38,605 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 830339e2e9604a73aebd633621216419 2023-11-12 00:55:38,606 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family1/830339e2e9604a73aebd633621216419 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/830339e2e9604a73aebd633621216419 2023-11-12 00:55:38,609 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 830339e2e9604a73aebd633621216419 2023-11-12 00:55:38,611 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 449920aa5f626fab14ce2ff9d43e75d0/family1 of 449920aa5f626fab14ce2ff9d43e75d0 into 830339e2e9604a73aebd633621216419(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:38,611 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:38,611 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:55:38,611 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 449920aa5f626fab14ce2ff9d43e75d0/family2 is initiating major compaction (all files) 2023-11-12 00:55:38,611 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:55:38,611 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:55:38,612 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 449920aa5f626fab14ce2ff9d43e75d0/family2 in ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:55:38,612 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/51e18b460d294b40b2a05b267a22d602, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/247bcf4cb4764d1f8766a1333677b684, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/46f74f90c0c74d4ab905dc23124b0920, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/dd49fbc9d3924063b008c2a238d2f5ff, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/359f5a18dea04b72ab43fcc0bc7ed227] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp, totalSize=25.3 K 2023-11-12 00:55:38,613 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 51e18b460d294b40b2a05b267a22d602, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750523805 2023-11-12 00:55:38,613 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 247bcf4cb4764d1f8766a1333677b684, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750525597 2023-11-12 00:55:38,614 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 46f74f90c0c74d4ab905dc23124b0920, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750527400 2023-11-12 00:55:38,614 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting dd49fbc9d3924063b008c2a238d2f5ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750529202 2023-11-12 00:55:38,614 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 359f5a18dea04b72ab43fcc0bc7ed227, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:55:38,623 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 449920aa5f626fab14ce2ff9d43e75d0#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:55:38,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/5e8910895f1c41c190512a09974b181c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/70d997b7382c4e07ac1b9cd11494cdf1, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/099e66374ca548118a33466ced0c42b9, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/fa978f4b19ed42879494f2816297e94c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/58ddf263d90147eab0d9fc8e70ea0d55] to archive 2023-11-12 00:55:38,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:38,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/5e8910895f1c41c190512a09974b181c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/5e8910895f1c41c190512a09974b181c 2023-11-12 00:55:38,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/70d997b7382c4e07ac1b9cd11494cdf1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/70d997b7382c4e07ac1b9cd11494cdf1 2023-11-12 00:55:38,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/099e66374ca548118a33466ced0c42b9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/099e66374ca548118a33466ced0c42b9 2023-11-12 00:55:38,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/fa978f4b19ed42879494f2816297e94c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/fa978f4b19ed42879494f2816297e94c 2023-11-12 00:55:38,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/58ddf263d90147eab0d9fc8e70ea0d55 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/58ddf263d90147eab0d9fc8e70ea0d55 2023-11-12 00:55:39,033 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311126a490dc7020c4c1a8c508f485ff94ff3_del 2023-11-12 00:55:39,034 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311126a490dc7020c4c1a8c508f485ff94ff3_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311126a490dc7020c4c1a8c508f485ff94ff3_del 2023-11-12 00:55:39,846 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1ac0a650ac54158b48b5938b2d1aa81 2023-11-12 00:55:39,847 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/.tmp/family2/b1ac0a650ac54158b48b5938b2d1aa81 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/b1ac0a650ac54158b48b5938b2d1aa81 2023-11-12 00:55:39,850 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1ac0a650ac54158b48b5938b2d1aa81 2023-11-12 00:55:39,851 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 449920aa5f626fab14ce2ff9d43e75d0/family2 of 449920aa5f626fab14ce2ff9d43e75d0 into b1ac0a650ac54158b48b5938b2d1aa81(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:55:39,851 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:39,854 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:39,856 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:39,859 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:39,860 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:39,866 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-12 00:55:39,881 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-12 00:55:39,883 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311124bd980e08f0f4100a94d24ca27d9a9a2_del 2023-11-12 00:55:39,886 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112409d385d4e71405aaed7bfd786f40aed_del 2023-11-12 00:55:39,889 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231112a4ea9913d2c046d0a93200cbcf8e09a1_del 2023-11-12 00:55:39,889 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:39,890 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(139): Connect 0x1ec5bc2b to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:55:39,895 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3857a0a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:55:39,896 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231112 for table='ns:testMinorCompaction' and column='family1' 2023-11-12 00:55:39,896 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231112 for table='ns:testMinorCompaction' and column='family1' 2023-11-12 00:55:39,896 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231112 for table='ns:testMinorCompaction' and column='family1' 2023-11-12 00:55:39,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/51e18b460d294b40b2a05b267a22d602, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/247bcf4cb4764d1f8766a1333677b684, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/46f74f90c0c74d4ab905dc23124b0920, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/dd49fbc9d3924063b008c2a238d2f5ff, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/359f5a18dea04b72ab43fcc0bc7ed227] to archive 2023-11-12 00:55:39,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:39,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/51e18b460d294b40b2a05b267a22d602 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/51e18b460d294b40b2a05b267a22d602 2023-11-12 00:55:39,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/247bcf4cb4764d1f8766a1333677b684 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/247bcf4cb4764d1f8766a1333677b684 2023-11-12 00:55:39,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/46f74f90c0c74d4ab905dc23124b0920 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/46f74f90c0c74d4ab905dc23124b0920 2023-11-12 00:55:39,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/dd49fbc9d3924063b008c2a238d2f5ff to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/dd49fbc9d3924063b008c2a238d2f5ff 2023-11-12 00:55:39,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/359f5a18dea04b72ab43fcc0bc7ed227 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family2/359f5a18dea04b72ab43fcc0bc7ed227 2023-11-12 00:55:40,732 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112cb89c9a4c4344be797570412a9fd5751 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231112cb89c9a4c4344be797570412a9fd5751 2023-11-12 00:55:40,732 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112362a6dce951a49f483f67a7998a8fb48 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112362a6dce951a49f483f67a7998a8fb48 2023-11-12 00:55:40,733 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,733 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,733 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112a9901665a4874aa796553f38ab776705 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231112a9901665a4874aa796553f38ab776705 2023-11-12 00:55:40,734 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,748 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:55:40,750 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:55:40,756 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:55:40,759 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:55:40,770 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231112/family1/23de416780544822a7ae4f4a3b55da1a first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-12 00:55:40,770 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/family1/4e751742269a4237a665f76b28ef85f6 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-12 00:55:40,771 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231112/family1/23de416780544822a7ae4f4a3b55da1a}] 2023-11-12 00:55:40,771 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/family1/4e751742269a4237a665f76b28ef85f6}] 2023-11-12 00:55:40,771 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231112/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-12 00:55:40,771 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231112/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c}] 2023-11-12 00:55:40,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231112/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c for inclusion in 449920aa5f626fab14ce2ff9d43e75d0/family1 2023-11-12 00:55:40,776 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231112/family1/23de416780544822a7ae4f4a3b55da1a for inclusion in 06e0eec5bf9ea0346eb6e2efb04818c0/family1 2023-11-12 00:55:40,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/family1/4e751742269a4237a665f76b28ef85f6 for inclusion in 9743d1cdc651fb2d06c421fbd8ca056c/family1 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last=1 2023-11-12 00:55:40,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:55:40,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231112/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__cqr1m883p95m2epa03hsof3so731gn36tr1rnqpm5155v7cpdc45kl49qgn6n7sm/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c 2023-11-12 00:55:40,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231112/family1/23de416780544822a7ae4f4a3b55da1a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__2l5uclgksvcif7907scgj29omu93bb7dho918noteob3inqgqkbcrk1fagq47i7q/family1/23de416780544822a7ae4f4a3b55da1a 2023-11-12 00:55:40,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231112/family1/4e751742269a4237a665f76b28ef85f6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__nndklqorg6v3c0kubcnqqr2dk1hdurjvebh2rb0tv62o6v5n2as31qppoanbfs8t/family1/4e751742269a4237a665f76b28ef85f6 2023-11-12 00:55:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__2l5uclgksvcif7907scgj29omu93bb7dho918noteob3inqgqkbcrk1fagq47i7q/family1/23de416780544822a7ae4f4a3b55da1a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2495b0e0104343f8aa01b6b78650bb87_SeqId_28_ 2023-11-12 00:55:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__cqr1m883p95m2epa03hsof3so731gn36tr1rnqpm5155v7cpdc45kl49qgn6n7sm/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/f5d2388ac59c42a295d2790c6e9517a6_SeqId_28_ 2023-11-12 00:55:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__nndklqorg6v3c0kubcnqqr2dk1hdurjvebh2rb0tv62o6v5n2as31qppoanbfs8t/family1/4e751742269a4237a665f76b28ef85f6 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/63df09b8798d42ca8efb034b16812777_SeqId_28_ 2023-11-12 00:55:40,783 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__2l5uclgksvcif7907scgj29omu93bb7dho918noteob3inqgqkbcrk1fagq47i7q/family1/23de416780544822a7ae4f4a3b55da1a into 06e0eec5bf9ea0346eb6e2efb04818c0/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2495b0e0104343f8aa01b6b78650bb87_SeqId_28_ - updating store file list. 2023-11-12 00:55:40,783 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__cqr1m883p95m2epa03hsof3so731gn36tr1rnqpm5155v7cpdc45kl49qgn6n7sm/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c into 449920aa5f626fab14ce2ff9d43e75d0/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/f5d2388ac59c42a295d2790c6e9517a6_SeqId_28_ - updating store file list. 2023-11-12 00:55:40,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__nndklqorg6v3c0kubcnqqr2dk1hdurjvebh2rb0tv62o6v5n2as31qppoanbfs8t/family1/4e751742269a4237a665f76b28ef85f6 into 9743d1cdc651fb2d06c421fbd8ca056c/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/63df09b8798d42ca8efb034b16812777_SeqId_28_ - updating store file list. 2023-11-12 00:55:40,788 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2495b0e0104343f8aa01b6b78650bb87_SeqId_28_ into 06e0eec5bf9ea0346eb6e2efb04818c0/family1 2023-11-12 00:55:40,788 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__2l5uclgksvcif7907scgj29omu93bb7dho918noteob3inqgqkbcrk1fagq47i7q/family1/23de416780544822a7ae4f4a3b55da1a into 06e0eec5bf9ea0346eb6e2efb04818c0/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/family1/2495b0e0104343f8aa01b6b78650bb87_SeqId_28_) 2023-11-12 00:55:40,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/f5d2388ac59c42a295d2790c6e9517a6_SeqId_28_ into 449920aa5f626fab14ce2ff9d43e75d0/family1 2023-11-12 00:55:40,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__cqr1m883p95m2epa03hsof3so731gn36tr1rnqpm5155v7cpdc45kl49qgn6n7sm/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c into 449920aa5f626fab14ce2ff9d43e75d0/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/family1/f5d2388ac59c42a295d2790c6e9517a6_SeqId_28_) 2023-11-12 00:55:40,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/63df09b8798d42ca8efb034b16812777_SeqId_28_ into 9743d1cdc651fb2d06c421fbd8ca056c/family1 2023-11-12 00:55:40,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__nndklqorg6v3c0kubcnqqr2dk1hdurjvebh2rb0tv62o6v5n2as31qppoanbfs8t/family1/4e751742269a4237a665f76b28ef85f6 into 9743d1cdc651fb2d06c421fbd8ca056c/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/family1/63df09b8798d42ca8efb034b16812777_SeqId_28_) 2023-11-12 00:55:40,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__2l5uclgksvcif7907scgj29omu93bb7dho918noteob3inqgqkbcrk1fagq47i7q/family1/23de416780544822a7ae4f4a3b55da1a 2023-11-12 00:55:40,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__nndklqorg6v3c0kubcnqqr2dk1hdurjvebh2rb0tv62o6v5n2as31qppoanbfs8t/family1/4e751742269a4237a665f76b28ef85f6 2023-11-12 00:55:40,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__ns_testMinorCompaction__cqr1m883p95m2epa03hsof3so731gn36tr1rnqpm5155v7cpdc45kl49qgn6n7sm/family1/b90b1ebf8f2941fb8616f8d6d7cc1f5c 2023-11-12 00:55:40,792 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,793 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:40,794 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,795 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111273b05e0e7bac49c4bd6da333690c37f8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111273b05e0e7bac49c4bd6da333690c37f8 2023-11-12 00:55:40,795 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-12 00:55:40,795 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231112' 2023-11-12 00:55:40,795 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:40,795 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231112 for table='ns:testMinorCompaction' and column='family1' 2023-11-12 00:55:40,796 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311127ad46d73e18b4af49bdba6e21e38a7b1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311127ad46d73e18b4af49bdba6e21e38a7b1 2023-11-12 00:55:40,796 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-12 00:55:40,796 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231112' 2023-11-12 00:55:40,797 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231112 for table='ns:testMinorCompaction' and column='family1' 2023-11-12 00:55:40,806 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,806 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:40,808 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112f5a54b4b6829470da133afae75388a8f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231112f5a54b4b6829470da133afae75388a8f 2023-11-12 00:55:40,808 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-12 00:55:40,808 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231112' 2023-11-12 00:55:40,808 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231112 for table='ns:testMinorCompaction' and column='family1' 2023-11-12 00:55:40,808 INFO [Listener at localhost/40343] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-12 00:55:40,811 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:40,814 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:40,817 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:55:40,818 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:55:40,840 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 292), OpenFileDescriptor=650 (was 797), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 145), ProcessCount=168 (was 169), AvailableMemoryMB=1169 (was 1118) - AvailableMemoryMB LEAK? - 2023-11-12 00:55:40,856 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=168, AvailableMemoryMB=1169 2023-11-12 00:55:40,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-12 00:55:40,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:40,860 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:55:40,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-12 00:55:40,861 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:55:40,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-12 00:55:40,862 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:40,863 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41 empty. 2023-11-12 00:55:40,863 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:40,863 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-12 00:55:40,876 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-12 00:55:40,877 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f5fa06a119e39fd446618c4b02243a41, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:40,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-12 00:55:41,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-12 00:55:41,283 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:41,283 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing f5fa06a119e39fd446618c4b02243a41, disabling compactions & flushes 2023-11-12 00:55:41,283 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,283 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,283 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. after waiting 0 ms 2023-11-12 00:55:41,283 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,283 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,283 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:41,285 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:55:41,286 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699750541286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750541286"}]},"ts":"1699750541286"} 2023-11-12 00:55:41,287 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-12 00:55:41,288 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:55:41,288 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750541288"}]},"ts":"1699750541288"} 2023-11-12 00:55:41,289 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-12 00:55:41,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f5fa06a119e39fd446618c4b02243a41, ASSIGN}] 2023-11-12 00:55:41,294 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f5fa06a119e39fd446618c4b02243a41, ASSIGN 2023-11-12 00:55:41,295 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f5fa06a119e39fd446618c4b02243a41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:41,446 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f5fa06a119e39fd446618c4b02243a41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:41,446 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699750541446"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750541446"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750541446"}]},"ts":"1699750541446"} 2023-11-12 00:55:41,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure f5fa06a119e39fd446618c4b02243a41, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:41,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-12 00:55:41,599 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:41,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5fa06a119e39fd446618c4b02243a41, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.', STARTKEY => '', ENDKEY => ''} 2023-11-12 00:55:41,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:41,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,603 INFO [StoreOpener-f5fa06a119e39fd446618c4b02243a41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,604 DEBUG [StoreOpener-f5fa06a119e39fd446618c4b02243a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:41,605 DEBUG [StoreOpener-f5fa06a119e39fd446618c4b02243a41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:41,605 INFO [StoreOpener-f5fa06a119e39fd446618c4b02243a41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5fa06a119e39fd446618c4b02243a41 columnFamilyName family1 2023-11-12 00:55:41,606 INFO [StoreOpener-f5fa06a119e39fd446618c4b02243a41-1] regionserver.HStore(310): Store=f5fa06a119e39fd446618c4b02243a41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:41,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:55:41,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:41,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f5fa06a119e39fd446618c4b02243a41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70317261, jitterRate=0.04780884087085724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-12 00:55:41,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:41,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41., pid=114, masterSystemTime=1699750541599 2023-11-12 00:55:41,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f5fa06a119e39fd446618c4b02243a41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:41,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699750541614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750541614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750541614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750541614"}]},"ts":"1699750541614"} 2023-11-12 00:55:41,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-12 00:55:41,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure f5fa06a119e39fd446618c4b02243a41, server=jenkins-hbase4.apache.org,43681,1699750400629 in 168 msec 2023-11-12 00:55:41,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-12 00:55:41,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f5fa06a119e39fd446618c4b02243a41, ASSIGN in 323 msec 2023-11-12 00:55:41,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:55:41,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750541618"}]},"ts":"1699750541618"} 2023-11-12 00:55:41,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-12 00:55:41,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:55:41,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 763 msec 2023-11-12 00:55:41,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-12 00:55:41,966 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-12 00:55:41,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:41,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,984 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:41,984 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:41,984 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:41,984 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:41,985 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,985 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,986 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:41,986 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:41,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:41,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:41,986 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:41,986 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:41,989 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:41,989 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:41,989 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:41,992 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:41,992 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:41,993 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:41,993 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:41,993 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-12 00:55:42,416 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cd558e46cc3e48d2bae5fdbdf8ec0469 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd558e46cc3e48d2bae5fdbdf8ec0469 2023-11-12 00:55:42,820 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/797ac8fd87374811a17e572e4f00a396 2023-11-12 00:55:42,824 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/797ac8fd87374811a17e572e4f00a396 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/797ac8fd87374811a17e572e4f00a396 2023-11-12 00:55:42,827 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/797ac8fd87374811a17e572e4f00a396, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-12 00:55:42,828 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 835ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:42,828 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:42,828 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:42,829 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:42,829 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:42,829 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:42,829 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,829 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:42,829 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,833 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:42,834 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,834 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:42,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:42,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fe360a[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:42,835 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:42,835 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,836 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,836 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:42,836 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:42,836 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:42,836 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,836 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:42,838 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,838 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:42,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:42,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:42,838 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:42,838 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:42,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:42,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:42,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:42,840 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:42,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:42,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:42,840 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,840 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:42,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:42,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:42,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,842 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:42,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:42,843 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,844 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:42,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,846 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:42,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:42,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:42,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:42,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:42,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:42,846 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,847 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:42,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:42,847 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,847 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:42,847 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:42,847 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,947 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:42,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:42,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:42,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:42,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,954 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:42,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:42,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:42,954 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:42,955 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,955 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,956 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,956 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:42,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:42,956 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:42,956 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,957 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:42,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:42,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:42,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:42,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:42,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:42,957 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:42,957 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:42,957 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:42,958 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-12 00:55:43,369 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d84db771dca145f5acf6957750e91b95 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d84db771dca145f5acf6957750e91b95 2023-11-12 00:55:43,774 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/18b147a5d7b54c23bc0d3d63dfa5630a 2023-11-12 00:55:43,778 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/18b147a5d7b54c23bc0d3d63dfa5630a as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18b147a5d7b54c23bc0d3d63dfa5630a 2023-11-12 00:55:43,781 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18b147a5d7b54c23bc0d3d63dfa5630a, entries=1, sequenceid=9, filesize=5.0 K 2023-11-12 00:55:43,782 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 824ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:43,782 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:43,782 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:43,784 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,784 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:43,784 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,784 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:43,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:43,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b11597[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:43,785 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:43,785 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,787 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,788 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:43,788 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:43,788 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:43,788 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,788 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:43,789 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:43,789 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:43,789 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,789 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:43,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:43,791 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:43,791 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:43,791 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:43,791 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,791 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:43,793 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,793 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:43,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,793 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:43,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:43,793 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,795 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:43,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:43,797 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:43,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:43,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:43,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:43,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,797 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:43,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:43,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:43,798 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:43,798 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:43,898 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:43,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:43,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:43,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:43,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,904 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:43,904 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:43,904 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:43,904 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:43,904 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,904 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,907 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:43,907 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:43,907 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:43,907 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,908 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:43,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:43,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:43,908 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:43,909 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:43,909 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:43,909 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:44,319 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010a886ab9d0ad46e39aa16ae9e52e037a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512010a886ab9d0ad46e39aa16ae9e52e037a 2023-11-12 00:55:44,724 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/18e245670ce24afcac5af16e8b018806 2023-11-12 00:55:44,728 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/18e245670ce24afcac5af16e8b018806 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18e245670ce24afcac5af16e8b018806 2023-11-12 00:55:44,731 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18e245670ce24afcac5af16e8b018806, entries=1, sequenceid=13, filesize=4.9 K 2023-11-12 00:55:44,732 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 823ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:44,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:44,732 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,734 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:44,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:44,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:44,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46c3563d[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:44,736 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:44,736 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,737 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,738 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:44,738 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:44,738 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,738 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:44,738 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:44,739 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:44,739 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,739 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,739 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:44,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:44,742 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:44,742 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:44,742 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:44,742 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,742 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:44,744 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:44,745 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,745 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:44,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:44,745 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,746 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,751 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:44,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:44,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:44,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:44,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:44,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,751 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:44,752 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:44,852 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:44,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:44,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:44,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:44,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,857 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:44,858 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:44,858 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:44,858 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:44,858 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,858 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,859 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:44,859 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:44,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:44,860 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:44,860 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:44,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,860 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,860 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:44,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:44,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:44,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:44,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:44,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:44,861 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:44,861 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:44,861 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:44,861 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:45,271 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058cf5aeada1614fd6b2d24c9dc24dc7f8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058cf5aeada1614fd6b2d24c9dc24dc7f8 2023-11-12 00:55:45,676 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/504809bd7cbc455b8c251ea1b22d100f 2023-11-12 00:55:45,681 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/504809bd7cbc455b8c251ea1b22d100f as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/504809bd7cbc455b8c251ea1b22d100f 2023-11-12 00:55:45,685 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/504809bd7cbc455b8c251ea1b22d100f, entries=1, sequenceid=17, filesize=4.9 K 2023-11-12 00:55:45,685 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 824ms, sequenceid=17, compaction requested=true 2023-11-12 00:55:45,686 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:45,686 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:45,686 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:45,687 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,687 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:45,688 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,688 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:45,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:45,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:45,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e2fcf54[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:45,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:45,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,692 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,692 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:45,692 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:45,692 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:45,692 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,692 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:45,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:45,693 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:45,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:45,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:45,696 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:45,696 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:45,696 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:45,696 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,696 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:45,698 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,698 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,698 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:45,698 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:45,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:45,699 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,702 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:45,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:45,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:45,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:45,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:45,703 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:45,702 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:45,703 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,703 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,803 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:45,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:45,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:45,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:45,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,808 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:45,808 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:45,808 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:45,808 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:45,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,809 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,812 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:45,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:45,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:45,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:45,812 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:45,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:45,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,813 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,813 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:45,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:45,813 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:45,813 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:45,813 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:45,813 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:46,224 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228abf96c14c8224774b39fa748769dccf9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228abf96c14c8224774b39fa748769dccf9 2023-11-12 00:55:46,629 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/3d6f6f6afcaf4554b5c99016eff3d084 2023-11-12 00:55:46,633 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/3d6f6f6afcaf4554b5c99016eff3d084 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/3d6f6f6afcaf4554b5c99016eff3d084 2023-11-12 00:55:46,636 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/3d6f6f6afcaf4554b5c99016eff3d084, entries=1, sequenceid=21, filesize=4.9 K 2023-11-12 00:55:46,638 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 825ms, sequenceid=21, compaction requested=true 2023-11-12 00:55:46,638 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:46,638 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:46,640 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:46,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:46,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e91e6fd[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:46,642 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:46,642 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,643 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,643 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:46,643 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:46,643 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:46,644 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,644 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:46,645 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:46,645 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:46,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:46,648 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:46,648 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:46,648 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:46,648 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,648 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:46,650 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,650 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,650 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:46,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:46,651 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:46,653 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:46,655 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:46,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:46,655 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:46,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:46,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:46,656 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:46,656 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:46,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:46,756 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:46,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:46,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:46,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:46,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,762 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:46,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:46,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:46,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:46,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,762 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,764 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:46,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:46,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:46,764 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:46,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:46,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:46,765 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:46,765 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:46,765 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:46,766 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:47,169 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:55:47,180 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231acbd08deec654a46ac808aaf75e03ea0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231acbd08deec654a46ac808aaf75e03ea0 2023-11-12 00:55:47,586 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/c4f58e26abf14bcfa564c0582bdd1823 2023-11-12 00:55:47,590 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/c4f58e26abf14bcfa564c0582bdd1823 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c4f58e26abf14bcfa564c0582bdd1823 2023-11-12 00:55:47,593 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c4f58e26abf14bcfa564c0582bdd1823, entries=1, sequenceid=25, filesize=4.9 K 2023-11-12 00:55:47,594 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 828ms, sequenceid=25, compaction requested=true 2023-11-12 00:55:47,594 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:47,594 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:47,596 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:47,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,596 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:47,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:47,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:47,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:47,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74864915[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:47,598 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:47,598 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,603 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:47,603 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:47,603 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,603 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:47,607 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:47,607 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:47,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:47,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:47,609 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:47,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:47,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:47,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,610 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:47,611 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,611 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:47,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:47,611 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:47,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:47,612 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,613 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:47,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:47,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:47,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,615 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:47,615 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:47,616 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,616 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:47,716 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:47,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:47,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:47,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:47,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,721 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:47,721 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:47,721 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:47,721 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:47,722 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,722 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,724 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,724 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:47,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:47,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:47,724 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:47,724 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:47,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:47,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:47,725 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:47,725 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:47,725 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:47,725 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:47,725 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:47,725 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:47,725 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:47,726 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:48,136 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010192f342c6e13944be80da1a99dc573c1b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010192f342c6e13944be80da1a99dc573c1b 2023-11-12 00:55:48,541 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/be4f81006399432085cd55e25b26fb76 2023-11-12 00:55:48,546 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/be4f81006399432085cd55e25b26fb76 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/be4f81006399432085cd55e25b26fb76 2023-11-12 00:55:48,549 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/be4f81006399432085cd55e25b26fb76, entries=1, sequenceid=29, filesize=4.9 K 2023-11-12 00:55:48,550 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 824ms, sequenceid=29, compaction requested=true 2023-11-12 00:55:48,550 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:48,550 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:48,550 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:48,550 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:48,550 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,550 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:48,550 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:48,552 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,552 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:48,552 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,552 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:48,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:48,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a89b06[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:48,554 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:48,554 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,555 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:48,555 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,555 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:48,555 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:48,556 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:48,556 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,556 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:48,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:48,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:48,556 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:48,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:48,558 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:48,559 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:48,559 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:48,559 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,559 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:48,561 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,561 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:48,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:48,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,561 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:48,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:48,562 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,563 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,565 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,565 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:48,565 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,565 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:48,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:48,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:48,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:48,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:48,565 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:48,565 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,566 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,566 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:48,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:48,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:48,566 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:48,666 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:48,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:48,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:48,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:48,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,672 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:48,672 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:48,672 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:48,672 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:48,672 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,672 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,674 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:48,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:48,674 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:48,674 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:48,674 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:48,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:48,675 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:48,675 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:48,675 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:48,676 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:48,676 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:48,676 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:48,676 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:48,676 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:49,086 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b171cf1b9a6d48e7845f268a728b1488 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b171cf1b9a6d48e7845f268a728b1488 2023-11-12 00:55:49,491 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/ebcc80eadbb24bc6a51a6af9c7b97566 2023-11-12 00:55:49,494 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/ebcc80eadbb24bc6a51a6af9c7b97566 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ebcc80eadbb24bc6a51a6af9c7b97566 2023-11-12 00:55:49,497 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ebcc80eadbb24bc6a51a6af9c7b97566, entries=1, sequenceid=33, filesize=4.9 K 2023-11-12 00:55:49,498 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 822ms, sequenceid=33, compaction requested=true 2023-11-12 00:55:49,498 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:49,498 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:49,498 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:49,500 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,500 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:49,500 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,500 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:49,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:49,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@588db428[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:49,502 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:49,502 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,504 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,504 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:49,504 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:49,504 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:49,505 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,505 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:49,506 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:49,506 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:49,506 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,506 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:49,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:49,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:49,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:49,508 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:49,508 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:49,508 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:49,508 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,508 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:49,510 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,510 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,510 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:49,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:49,510 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:49,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:49,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,512 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:49,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:49,514 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:49,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:49,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:49,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:49,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:49,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:49,514 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:49,515 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,515 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,515 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,515 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:49,515 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:49,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:49,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:49,615 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:49,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:49,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:49,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:49,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,620 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:49,620 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:49,620 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:49,620 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:49,621 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,621 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,623 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:49,623 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:49,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:49,624 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:49,624 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:49,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:49,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,624 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,625 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:49,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:49,625 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:49,625 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:49,625 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:49,625 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:50,036 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090768fb364c6da149659797b8a02802db7a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090768fb364c6da149659797b8a02802db7a 2023-11-12 00:55:50,440 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/75b4ece7ccd4494d8cc8195f912ee1ce 2023-11-12 00:55:50,444 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/75b4ece7ccd4494d8cc8195f912ee1ce as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/75b4ece7ccd4494d8cc8195f912ee1ce 2023-11-12 00:55:50,448 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/75b4ece7ccd4494d8cc8195f912ee1ce, entries=1, sequenceid=37, filesize=4.9 K 2023-11-12 00:55:50,448 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 823ms, sequenceid=37, compaction requested=true 2023-11-12 00:55:50,448 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:50,449 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:50,449 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:50,454 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,454 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:50,454 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,454 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:50,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:50,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:50,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@295a07ca[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:50,455 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:50,455 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,456 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,456 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:50,456 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:50,457 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:50,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,457 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:50,458 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,458 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:50,458 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:50,458 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:50,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:50,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:50,460 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:50,460 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:50,460 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:50,461 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,461 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:50,463 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:50,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,464 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:50,464 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:50,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:50,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,465 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:50,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:50,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:50,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:50,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:50,475 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,475 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:50,476 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,476 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:50,476 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,476 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:50,576 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:50,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:50,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:50,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:50,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,582 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:50,582 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:50,582 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-12 00:55:50,582 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-12 00:55:50,582 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,582 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,583 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:50,583 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:50,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:50,584 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:50,584 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:50,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,584 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-12 00:55:50,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-12 00:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-12 00:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-12 00:55:50,585 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:50,585 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:50,585 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. started... 2023-11-12 00:55:50,585 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5fa06a119e39fd446618c4b02243a41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-12 00:55:50,996 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204b0e9a15730d40d087fec7d25efb8250 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511204b0e9a15730d40d087fec7d25efb8250 2023-11-12 00:55:51,402 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/c1cfb799380c4342b6728e5032891edb 2023-11-12 00:55:51,405 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/c1cfb799380c4342b6728e5032891edb as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c1cfb799380c4342b6728e5032891edb 2023-11-12 00:55:51,409 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c1cfb799380c4342b6728e5032891edb, entries=1, sequenceid=41, filesize=4.9 K 2023-11-12 00:55:51,409 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f5fa06a119e39fd446618c4b02243a41 in 824ms, sequenceid=41, compaction requested=true 2023-11-12 00:55:51,409 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:51,409 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:51,409 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-12 00:55:51,409 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-12 00:55:51,410 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,410 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-12 00:55:51,410 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-12 00:55:51,411 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,411 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:51,411 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,412 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-12 00:55:51,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f523d15[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:51,413 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-12 00:55:51,413 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,415 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-12 00:55:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-12 00:55:51,415 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:51,415 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,415 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:51,416 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,416 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-12 00:55:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:51,416 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:51,417 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-12 00:55:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:51,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-12 00:55:51,419 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-12 00:55:51,419 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:51,419 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:51,419 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,419 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:51,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,421 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:51,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:51,421 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,422 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,424 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,424 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,424 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,425 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:51,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-12 00:55:51,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-12 00:55:51,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:51,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,425 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:51,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:51,525 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:51,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:51,527 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-12 00:55:51,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:55:51,529 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:55:51,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:55:51,530 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751151530 2023-11-12 00:55:51,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-12 00:55:51,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-12 00:55:51,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:51,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x1be38d19 to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:55:51,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28f363e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:55:51,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:52,362 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031cf51cae0ac049f5929787cf6ef4bc83 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601031cf51cae0ac049f5929787cf6ef4bc83 2023-11-12 00:55:52,364 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:52,377 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:55:52,379 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:55:52,386 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:55:52,387 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:55:52,394 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e6fd9eb1049a46a8b196ca2471612fbd first=Optional[r5] last=Optional[r6] 2023-11-12 00:55:52,395 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e6fd9eb1049a46a8b196ca2471612fbd}] 2023-11-12 00:55:52,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e6fd9eb1049a46a8b196ca2471612fbd for inclusion in f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:52,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-12 00:55:52,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:55:52,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:52,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e6fd9eb1049a46a8b196ca2471612fbd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5rme8ptmiftaguk7r7qd9m8emjhe14caff0gj10c5nmqrumk2tl5ddh0kdatva33/family1/e6fd9eb1049a46a8b196ca2471612fbd 2023-11-12 00:55:52,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5rme8ptmiftaguk7r7qd9m8emjhe14caff0gj10c5nmqrumk2tl5ddh0kdatva33/family1/e6fd9eb1049a46a8b196ca2471612fbd as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_ 2023-11-12 00:55:52,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5rme8ptmiftaguk7r7qd9m8emjhe14caff0gj10c5nmqrumk2tl5ddh0kdatva33/family1/e6fd9eb1049a46a8b196ca2471612fbd into f5fa06a119e39fd446618c4b02243a41/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_ - updating store file list. 2023-11-12 00:55:52,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_ into f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:52,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5rme8ptmiftaguk7r7qd9m8emjhe14caff0gj10c5nmqrumk2tl5ddh0kdatva33/family1/e6fd9eb1049a46a8b196ca2471612fbd into f5fa06a119e39fd446618c4b02243a41/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_) 2023-11-12 00:55:52,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__5rme8ptmiftaguk7r7qd9m8emjhe14caff0gj10c5nmqrumk2tl5ddh0kdatva33/family1/e6fd9eb1049a46a8b196ca2471612fbd 2023-11-12 00:55:52,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-12 00:55:52,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-12 00:55:52,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): f5fa06a119e39fd446618c4b02243a41/family1 is initiating minor compaction 2023-11-12 00:55:52,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c90c843; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:52,413 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f5fa06a119e39fd446618c4b02243a41/family1 in testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:52,413 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18b147a5d7b54c23bc0d3d63dfa5630a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18e245670ce24afcac5af16e8b018806, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/504809bd7cbc455b8c251ea1b22d100f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/3d6f6f6afcaf4554b5c99016eff3d084, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c4f58e26abf14bcfa564c0582bdd1823, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/be4f81006399432085cd55e25b26fb76, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ebcc80eadbb24bc6a51a6af9c7b97566, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/75b4ece7ccd4494d8cc8195f912ee1ce, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c1cfb799380c4342b6728e5032891edb, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp, totalSize=49.7 K 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 18b147a5d7b54c23bc0d3d63dfa5630a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 18e245670ce24afcac5af16e8b018806, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 504809bd7cbc455b8c251ea1b22d100f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 3d6f6f6afcaf4554b5c99016eff3d084, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting c4f58e26abf14bcfa564c0582bdd1823, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting be4f81006399432085cd55e25b26fb76, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting ebcc80eadbb24bc6a51a6af9c7b97566, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 75b4ece7ccd4494d8cc8195f912ee1ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting c1cfb799380c4342b6728e5032891edb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-12 00:55:52,414 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting ac478a2ca8324157ae9ec8d508b85737_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-12 00:55:52,415 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:52,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:52,417 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010192f342c6e13944be80da1a99dc573c1b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010192f342c6e13944be80da1a99dc573c1b 2023-11-12 00:55:52,418 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b171cf1b9a6d48e7845f268a728b1488 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b171cf1b9a6d48e7845f268a728b1488 2023-11-12 00:55:52,418 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-12 00:55:52,418 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-12 00:55:52,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:52,419 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:52,452 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): f5fa06a119e39fd446618c4b02243a41#family1#compaction#166 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-12 00:55:52,875 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/1118616f91a647f2b1708703c0a3105c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/1118616f91a647f2b1708703c0a3105c 2023-11-12 00:55:52,880 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f5fa06a119e39fd446618c4b02243a41/family1 of f5fa06a119e39fd446618c4b02243a41 into 1118616f91a647f2b1708703c0a3105c(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:52,880 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:52,880 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699750552413; duration=0sec 2023-11-12 00:55:52,880 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:52,881 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316ec0a7365eaf4f079f5edad2ec478a78 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512316ec0a7365eaf4f079f5edad2ec478a78 2023-11-12 00:55:52,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:52,904 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/30b08fb55c5a43a4b0c2e76364914306 first=Optional[r1] last=Optional[r4] 2023-11-12 00:55:52,905 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/30b08fb55c5a43a4b0c2e76364914306}] 2023-11-12 00:55:52,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/30b08fb55c5a43a4b0c2e76364914306 for inclusion in f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:52,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-12 00:55:52,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:55:52,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:52,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/30b08fb55c5a43a4b0c2e76364914306 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dufvcj20gf7fpfrpjibm9m78ob57j64g05aohh5773jdh6f5dhjfj9se6rm1ad0h/family1/30b08fb55c5a43a4b0c2e76364914306 2023-11-12 00:55:52,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dufvcj20gf7fpfrpjibm9m78ob57j64g05aohh5773jdh6f5dhjfj9se6rm1ad0h/family1/30b08fb55c5a43a4b0c2e76364914306 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_ 2023-11-12 00:55:52,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dufvcj20gf7fpfrpjibm9m78ob57j64g05aohh5773jdh6f5dhjfj9se6rm1ad0h/family1/30b08fb55c5a43a4b0c2e76364914306 into f5fa06a119e39fd446618c4b02243a41/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_ - updating store file list. 2023-11-12 00:55:52,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_ into f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:52,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dufvcj20gf7fpfrpjibm9m78ob57j64g05aohh5773jdh6f5dhjfj9se6rm1ad0h/family1/30b08fb55c5a43a4b0c2e76364914306 into f5fa06a119e39fd446618c4b02243a41/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_) 2023-11-12 00:55:52,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__dufvcj20gf7fpfrpjibm9m78ob57j64g05aohh5773jdh6f5dhjfj9se6rm1ad0h/family1/30b08fb55c5a43a4b0c2e76364914306 2023-11-12 00:55:52,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-12 00:55:52,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-12 00:55:52,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(1912): f5fa06a119e39fd446618c4b02243a41/family1 is initiating minor compaction (all files) 2023-11-12 00:55:52,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e2cab16; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:52,917 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f5fa06a119e39fd446618c4b02243a41/family1 in testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:55:52,917 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/797ac8fd87374811a17e572e4f00a396, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/1118616f91a647f2b1708703c0a3105c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp, totalSize=178.1 K 2023-11-12 00:55:52,917 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 797ac8fd87374811a17e572e4f00a396, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823723 2023-11-12 00:55:52,918 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 1118616f91a647f2b1708703c0a3105c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223723 2023-11-12 00:55:52,918 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] compactions.Compactor(207): Compacting 89736dea854647fa8310c404e86d8e3e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223723 2023-11-12 00:55:52,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:52,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:52,921 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512010a886ab9d0ad46e39aa16ae9e52e037a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512010a886ab9d0ad46e39aa16ae9e52e037a 2023-11-12 00:55:52,923 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058cf5aeada1614fd6b2d24c9dc24dc7f8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058cf5aeada1614fd6b2d24c9dc24dc7f8 2023-11-12 00:55:52,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228abf96c14c8224774b39fa748769dccf9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228abf96c14c8224774b39fa748769dccf9 2023-11-12 00:55:52,925 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231acbd08deec654a46ac808aaf75e03ea0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231acbd08deec654a46ac808aaf75e03ea0 2023-11-12 00:55:52,925 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-12 00:55:52,925 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-12 00:55:52,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:52,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:52,932 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] throttle.PressureAwareThroughputController(145): f5fa06a119e39fd446618c4b02243a41#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-12 00:55:52,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18b147a5d7b54c23bc0d3d63dfa5630a, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18e245670ce24afcac5af16e8b018806, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/504809bd7cbc455b8c251ea1b22d100f, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/3d6f6f6afcaf4554b5c99016eff3d084, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c4f58e26abf14bcfa564c0582bdd1823, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/be4f81006399432085cd55e25b26fb76, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ebcc80eadbb24bc6a51a6af9c7b97566, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/75b4ece7ccd4494d8cc8195f912ee1ce, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c1cfb799380c4342b6728e5032891edb, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_] to archive 2023-11-12 00:55:52,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:52,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18b147a5d7b54c23bc0d3d63dfa5630a to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18b147a5d7b54c23bc0d3d63dfa5630a 2023-11-12 00:55:52,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18e245670ce24afcac5af16e8b018806 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/18e245670ce24afcac5af16e8b018806 2023-11-12 00:55:52,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/504809bd7cbc455b8c251ea1b22d100f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/504809bd7cbc455b8c251ea1b22d100f 2023-11-12 00:55:52,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/3d6f6f6afcaf4554b5c99016eff3d084 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/3d6f6f6afcaf4554b5c99016eff3d084 2023-11-12 00:55:52,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c4f58e26abf14bcfa564c0582bdd1823 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c4f58e26abf14bcfa564c0582bdd1823 2023-11-12 00:55:52,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/be4f81006399432085cd55e25b26fb76 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/be4f81006399432085cd55e25b26fb76 2023-11-12 00:55:52,943 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ebcc80eadbb24bc6a51a6af9c7b97566 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ebcc80eadbb24bc6a51a6af9c7b97566 2023-11-12 00:55:52,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/75b4ece7ccd4494d8cc8195f912ee1ce to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/75b4ece7ccd4494d8cc8195f912ee1ce 2023-11-12 00:55:52,945 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c1cfb799380c4342b6728e5032891edb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/c1cfb799380c4342b6728e5032891edb 2023-11-12 00:55:52,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ac478a2ca8324157ae9ec8d508b85737_SeqId_44_ 2023-11-12 00:55:52,964 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/.tmp/family1/ab35371b49c845bfa776a34013b08bb1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/ab35371b49c845bfa776a34013b08bb1 2023-11-12 00:55:52,969 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f5fa06a119e39fd446618c4b02243a41/family1 of f5fa06a119e39fd446618c4b02243a41 into ab35371b49c845bfa776a34013b08bb1(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:55:52,969 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:52,969 INFO [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699750552917; duration=0sec 2023-11-12 00:55:52,969 DEBUG [RS:0;jenkins-hbase4:43681-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-12 00:55:53,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/797ac8fd87374811a17e572e4f00a396, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/1118616f91a647f2b1708703c0a3105c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_] to archive 2023-11-12 00:55:53,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:53,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/797ac8fd87374811a17e572e4f00a396 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/797ac8fd87374811a17e572e4f00a396 2023-11-12 00:55:53,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/1118616f91a647f2b1708703c0a3105c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/1118616f91a647f2b1708703c0a3105c 2023-11-12 00:55:53,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_ to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/89736dea854647fa8310c404e86d8e3e_SeqId_47_ 2023-11-12 00:55:53,382 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302301e45d43064de2b28826fb6413ee1e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511302301e45d43064de2b28826fb6413ee1e 2023-11-12 00:55:53,383 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:53,405 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/166226e957cd4806bcd86351a8ada5f8 first=Optional[r00] last=Optional[r8] 2023-11-12 00:55:53,405 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/166226e957cd4806bcd86351a8ada5f8}] 2023-11-12 00:55:53,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/166226e957cd4806bcd86351a8ada5f8 for inclusion in f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:53,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-12 00:55:53,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last= 2023-11-12 00:55:53,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:55:53,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/166226e957cd4806bcd86351a8ada5f8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6paf5vn67k25kgkqd3k9v1kpthl89k6j5uu25u6kclr5a9sgs8580a62fjldphn4/family1/166226e957cd4806bcd86351a8ada5f8 2023-11-12 00:55:53,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6paf5vn67k25kgkqd3k9v1kpthl89k6j5uu25u6kclr5a9sgs8580a62fjldphn4/family1/166226e957cd4806bcd86351a8ada5f8 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/140bcad79b7347dba14b6b20a461276c_SeqId_50_ 2023-11-12 00:55:53,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6paf5vn67k25kgkqd3k9v1kpthl89k6j5uu25u6kclr5a9sgs8580a62fjldphn4/family1/166226e957cd4806bcd86351a8ada5f8 into f5fa06a119e39fd446618c4b02243a41/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/140bcad79b7347dba14b6b20a461276c_SeqId_50_ - updating store file list. 2023-11-12 00:55:53,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/140bcad79b7347dba14b6b20a461276c_SeqId_50_ into f5fa06a119e39fd446618c4b02243a41/family1 2023-11-12 00:55:53,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6paf5vn67k25kgkqd3k9v1kpthl89k6j5uu25u6kclr5a9sgs8580a62fjldphn4/family1/166226e957cd4806bcd86351a8ada5f8 into f5fa06a119e39fd446618c4b02243a41/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/family1/140bcad79b7347dba14b6b20a461276c_SeqId_50_) 2023-11-12 00:55:53,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMinorCompactionWithMonthlyPolicy__6paf5vn67k25kgkqd3k9v1kpthl89k6j5uu25u6kclr5a9sgs8580a62fjldphn4/family1/166226e957cd4806bcd86351a8ada5f8 2023-11-12 00:55:53,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:53,418 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:55:53,419 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511204b0e9a15730d40d087fec7d25efb8250 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511204b0e9a15730d40d087fec7d25efb8250 2023-11-12 00:55:53,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d84db771dca145f5acf6957750e91b95 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d84db771dca145f5acf6957750e91b95 2023-11-12 00:55:53,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd558e46cc3e48d2bae5fdbdf8ec0469 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd558e46cc3e48d2bae5fdbdf8ec0469 2023-11-12 00:55:53,421 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-12 00:55:53,421 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-12 00:55:53,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:53,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:53,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-12 00:55:53,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-12 00:55:53,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:55:53,424 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-12 00:55:53,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8960 sec 2023-11-12 00:55:53,633 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256 (was 250) - Thread LEAK? -, OpenFileDescriptor=675 (was 650) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 135), ProcessCount=168 (was 168), AvailableMemoryMB=1159 (was 1169) 2023-11-12 00:55:53,644 INFO [Listener at localhost/40343] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=256, OpenFileDescriptor=675, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=168, AvailableMemoryMB=1159 2023-11-12 00:55:53,663 DEBUG [Listener at localhost/40343] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-12 00:55:53,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xBCkg6\xAC\xB8S\x14\xCA/H"3t\x17\xBF"\x10\xAD\x007\xA1X\xA7(\x80\xCE\x8E\xED\x96\x87\xFA\x02\xA4*\x10\x82J\x17RZT\x95\x86%=\xAD\xEF\x0F\x0E[\xA02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-12 00:55:53,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-12 00:55:53,721 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-12 00:55:53,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-12 00:55:53,722 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-12 00:55:53,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-12 00:55:53,723 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:53,723 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:53,723 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:53,724 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57 empty. 2023-11-12 00:55:53,724 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e empty. 2023-11-12 00:55:53,724 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9 empty. 2023-11-12 00:55:53,724 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:53,724 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:53,724 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:53,724 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-12 00:55:53,731 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-12 00:55:53,732 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => a42ba8bcf7a2d17d2a9e3b6bc8cc432e, NAME => 'testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xBCkg6\xAC\xB8S\x14\xCA/H"3t\x17\xBF"\x10\xAD\x007\xA1X\xA7(\x80\xCE\x8E\xED\x96\x87\xFA\x02\xA4*\x10\x82J\x17RZT\x95\x86%=\xAD\xEF\x0F\x0E[\xA02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:53,732 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => b0b9775d0ec55d580d7732f12aa5fda9, NAME => 'testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xBCkg6\xAC\xB8S\x14\xCA/H"3t\x17\xBF"\x10\xAD\x007\xA1X\xA7(\x80\xCE\x8E\xED\x96\x87\xFA\x02\xA4*\x10\x82J\x17RZT\x95\x86%=\xAD\xEF\x0F\x0E[\xA02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:53,732 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6f10f9ddb9807fd2fa78c148dd070a57, NAME => 'testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xBCkg6\xAC\xB8S\x14\xCA/H"3t\x17\xBF"\x10\xAD\x007\xA1X\xA7(\x80\xCE\x8E\xED\x96\x87\xFA\x02\xA4*\x10\x82J\x17RZT\x95\x86%=\xAD\xEF\x0F\x0E[\xA02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/.tmp 2023-11-12 00:55:53,742 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:53,742 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing b0b9775d0ec55d580d7732f12aa5fda9, disabling compactions & flushes 2023-11-12 00:55:53,742 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:53,742 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 6f10f9ddb9807fd2fa78c148dd070a57, disabling compactions & flushes 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. after waiting 0 ms 2023-11-12 00:55:53,743 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. after waiting 0 ms 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:53,743 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:53,743 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:55:53,743 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:55:53,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-12 00:55:54,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-12 00:55:54,140 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:54,140 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing a42ba8bcf7a2d17d2a9e3b6bc8cc432e, disabling compactions & flushes 2023-11-12 00:55:54,140 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,140 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,140 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. after waiting 0 ms 2023-11-12 00:55:54,140 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,140 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,140 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:55:54,142 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-12 00:55:54,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699750554143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750554143"}]},"ts":"1699750554143"} 2023-11-12 00:55:54,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750554143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750554143"}]},"ts":"1699750554143"} 2023-11-12 00:55:54,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750554143"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699750554143"}]},"ts":"1699750554143"} 2023-11-12 00:55:54,145 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-12 00:55:54,145 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-12 00:55:54,146 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750554145"}]},"ts":"1699750554145"} 2023-11-12 00:55:54,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-12 00:55:54,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6f10f9ddb9807fd2fa78c148dd070a57, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b0b9775d0ec55d580d7732f12aa5fda9, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a42ba8bcf7a2d17d2a9e3b6bc8cc432e, ASSIGN}] 2023-11-12 00:55:54,152 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6f10f9ddb9807fd2fa78c148dd070a57, ASSIGN 2023-11-12 00:55:54,152 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a42ba8bcf7a2d17d2a9e3b6bc8cc432e, ASSIGN 2023-11-12 00:55:54,152 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b0b9775d0ec55d580d7732f12aa5fda9, ASSIGN 2023-11-12 00:55:54,153 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6f10f9ddb9807fd2fa78c148dd070a57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:54,153 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a42ba8bcf7a2d17d2a9e3b6bc8cc432e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:54,153 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b0b9775d0ec55d580d7732f12aa5fda9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43681,1699750400629; forceNewPlan=false, retain=false 2023-11-12 00:55:54,305 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=6f10f9ddb9807fd2fa78c148dd070a57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,305 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=a42ba8bcf7a2d17d2a9e3b6bc8cc432e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,305 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750554304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750554304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750554304"}]},"ts":"1699750554304"} 2023-11-12 00:55:54,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b0b9775d0ec55d580d7732f12aa5fda9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,305 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750554304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750554304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750554304"}]},"ts":"1699750554304"} 2023-11-12 00:55:54,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699750554304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1699750554304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699750554304"}]},"ts":"1699750554304"} 2023-11-12 00:55:54,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 6f10f9ddb9807fd2fa78c148dd070a57, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:54,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure a42ba8bcf7a2d17d2a9e3b6bc8cc432e, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:54,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure b0b9775d0ec55d580d7732f12aa5fda9, server=jenkins-hbase4.apache.org,43681,1699750400629}] 2023-11-12 00:55:54,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-12 00:55:54,457 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:54,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f10f9ddb9807fd2fa78c148dd070a57, NAME => 'testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.', STARTKEY => '', ENDKEY => '1'} 2023-11-12 00:55:54,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:54,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,481 INFO [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,482 DEBUG [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1 2023-11-12 00:55:54,482 DEBUG [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1 2023-11-12 00:55:54,483 INFO [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f10f9ddb9807fd2fa78c148dd070a57 columnFamilyName family1 2023-11-12 00:55:54,484 INFO [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] regionserver.HStore(310): Store=6f10f9ddb9807fd2fa78c148dd070a57/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:54,484 INFO [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,485 DEBUG [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2 2023-11-12 00:55:54,485 DEBUG [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2 2023-11-12 00:55:54,485 INFO [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f10f9ddb9807fd2fa78c148dd070a57 columnFamilyName family2 2023-11-12 00:55:54,486 INFO [StoreOpener-6f10f9ddb9807fd2fa78c148dd070a57-1] regionserver.HStore(310): Store=6f10f9ddb9807fd2fa78c148dd070a57/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:54,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:54,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:55:54,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:54,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f10f9ddb9807fd2fa78c148dd070a57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58914908, jitterRate=-0.12209945917129517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:54,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:55:54,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57., pid=120, masterSystemTime=1699750554457 2023-11-12 00:55:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:54,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:54,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a42ba8bcf7a2d17d2a9e3b6bc8cc432e, NAME => 'testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.', STARTKEY => '2', ENDKEY => ''} 2023-11-12 00:55:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,494 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=6f10f9ddb9807fd2fa78c148dd070a57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,494 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750554494"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750554494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750554494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750554494"}]},"ts":"1699750554494"} 2023-11-12 00:55:54,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-12 00:55:54,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 6f10f9ddb9807fd2fa78c148dd070a57, server=jenkins-hbase4.apache.org,43681,1699750400629 in 189 msec 2023-11-12 00:55:54,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6f10f9ddb9807fd2fa78c148dd070a57, ASSIGN in 346 msec 2023-11-12 00:55:54,515 INFO [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,516 DEBUG [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 2023-11-12 00:55:54,516 DEBUG [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 2023-11-12 00:55:54,516 INFO [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a42ba8bcf7a2d17d2a9e3b6bc8cc432e columnFamilyName family1 2023-11-12 00:55:54,517 INFO [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] regionserver.HStore(310): Store=a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:54,517 INFO [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,518 DEBUG [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2 2023-11-12 00:55:54,518 DEBUG [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2 2023-11-12 00:55:54,518 INFO [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a42ba8bcf7a2d17d2a9e3b6bc8cc432e columnFamilyName family2 2023-11-12 00:55:54,519 INFO [StoreOpener-a42ba8bcf7a2d17d2a9e3b6bc8cc432e-1] regionserver.HStore(310): Store=a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:54,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:54,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:55:54,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:54,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a42ba8bcf7a2d17d2a9e3b6bc8cc432e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65379904, jitterRate=-0.025763511657714844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:54,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:55:54,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e., pid=121, masterSystemTime=1699750554457 2023-11-12 00:55:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0b9775d0ec55d580d7732f12aa5fda9, NAME => 'testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.', STARTKEY => '1', ENDKEY => '2'} 2023-11-12 00:55:54,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=a42ba8bcf7a2d17d2a9e3b6bc8cc432e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-12 00:55:54,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699750554525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750554525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750554525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750554525"}]},"ts":"1699750554525"} 2023-11-12 00:55:54,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=119 2023-11-12 00:55:54,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure a42ba8bcf7a2d17d2a9e3b6bc8cc432e, server=jenkins-hbase4.apache.org,43681,1699750400629 in 220 msec 2023-11-12 00:55:54,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a42ba8bcf7a2d17d2a9e3b6bc8cc432e, ASSIGN in 377 msec 2023-11-12 00:55:54,546 INFO [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,547 DEBUG [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1 2023-11-12 00:55:54,547 DEBUG [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1 2023-11-12 00:55:54,547 INFO [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0b9775d0ec55d580d7732f12aa5fda9 columnFamilyName family1 2023-11-12 00:55:54,548 INFO [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] regionserver.HStore(310): Store=b0b9775d0ec55d580d7732f12aa5fda9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:54,548 INFO [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,549 DEBUG [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2 2023-11-12 00:55:54,549 DEBUG [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2 2023-11-12 00:55:54,549 INFO [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0b9775d0ec55d580d7732f12aa5fda9 columnFamilyName family2 2023-11-12 00:55:54,550 INFO [StoreOpener-b0b9775d0ec55d580d7732f12aa5fda9-1] regionserver.HStore(310): Store=b0b9775d0ec55d580d7732f12aa5fda9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-12 00:55:54,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-12 00:55:54,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:55:54,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-12 00:55:54,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b0b9775d0ec55d580d7732f12aa5fda9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59557125, jitterRate=-0.1125296801328659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-12 00:55:54,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:55:54,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9., pid=122, masterSystemTime=1699750554457 2023-11-12 00:55:54,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:54,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:54,556 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=b0b9775d0ec55d580d7732f12aa5fda9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,556 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699750554556"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1699750554556"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699750554556"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699750554556"}]},"ts":"1699750554556"} 2023-11-12 00:55:54,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-11-12 00:55:54,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure b0b9775d0ec55d580d7732f12aa5fda9, server=jenkins-hbase4.apache.org,43681,1699750400629 in 250 msec 2023-11-12 00:55:54,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-11-12 00:55:54,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b0b9775d0ec55d580d7732f12aa5fda9, ASSIGN in 407 msec 2023-11-12 00:55:54,560 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-12 00:55:54,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699750554560"}]},"ts":"1699750554560"} 2023-11-12 00:55:54,561 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-12 00:55:54,563 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-12 00:55:54,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 844 msec 2023-11-12 00:55:54,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-12 00:55:54,826 INFO [Listener at localhost/40343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-12 00:55:54,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:54,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:54,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:54,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:54,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-12 00:55:54,847 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-12 00:55:54,848 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:54,848 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-12 00:55:54,848 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-12 00:55:54,848 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:54,848 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:54,850 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,850 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:54,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:54,850 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:54,850 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:54,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:54,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-12 00:55:54,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-12 00:55:54,851 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-12 00:55:54,851 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:54,851 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-12 00:55:54,852 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:54,852 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:54,852 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:54,852 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. started... 2023-11-12 00:55:54,852 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:54,852 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:54,852 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. started... 2023-11-12 00:55:54,852 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. started... 2023-11-12 00:55:54,853 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f10f9ddb9807fd2fa78c148dd070a57 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:54,854 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b0b9775d0ec55d580d7732f12aa5fda9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:54,854 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-12 00:55:54,907 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311125cb8ba24103d4420b7833bad85432704 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311125cb8ba24103d4420b7833bad85432704 2023-11-12 00:55:54,908 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112468d7e00dc7b43c2a28e0d09366aa2dd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112468d7e00dc7b43c2a28e0d09366aa2dd 2023-11-12 00:55:54,915 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112c09d52939c2e4370b04685a943cf330e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231112c09d52939c2e4370b04685a943cf330e 2023-11-12 00:55:54,924 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/7edc2fd0baca4accb6850cb5bccc18e4 2023-11-12 00:55:54,933 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/46cb907aec4a440eae06f7256fec4467 2023-11-12 00:55:54,966 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112d528ef4a092c4984927b8fde56f5bd12 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231112d528ef4a092c4984927b8fde56f5bd12 2023-11-12 00:55:54,970 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/7d27c8ee89ee46108b9498ce7bed3952 2023-11-12 00:55:54,974 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/46cb907aec4a440eae06f7256fec4467 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/46cb907aec4a440eae06f7256fec4467 2023-11-12 00:55:54,998 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/46cb907aec4a440eae06f7256fec4467, entries=4, sequenceid=5, filesize=5.5 K 2023-11-12 00:55:54,998 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/7d27c8ee89ee46108b9498ce7bed3952 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/7d27c8ee89ee46108b9498ce7bed3952 2023-11-12 00:55:55,002 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/7d27c8ee89ee46108b9498ce7bed3952, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:55,003 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a42ba8bcf7a2d17d2a9e3b6bc8cc432e in 150ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:55,003 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-12 00:55:55,004 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:55:55,004 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:55,004 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:55,328 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/7d5babe9fd2d42d596f78982bc0eb07e 2023-11-12 00:55:55,371 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111206f498cecc6c4f2ab46f0c29c19e3098 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111206f498cecc6c4f2ab46f0c29c19e3098 2023-11-12 00:55:55,763 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112a73d4317d76b467a8fbc2481d8b2ecc5 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231112a73d4317d76b467a8fbc2481d8b2ecc5 2023-11-12 00:55:55,776 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/496f766de78048a396212d5939074c70 2023-11-12 00:55:55,779 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/7edc2fd0baca4accb6850cb5bccc18e4 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/7edc2fd0baca4accb6850cb5bccc18e4 2023-11-12 00:55:55,802 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/7edc2fd0baca4accb6850cb5bccc18e4, entries=4, sequenceid=5, filesize=5.5 K 2023-11-12 00:55:55,802 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/496f766de78048a396212d5939074c70 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/496f766de78048a396212d5939074c70 2023-11-12 00:55:55,805 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/496f766de78048a396212d5939074c70, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:55,806 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b0b9775d0ec55d580d7732f12aa5fda9 in 952ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:55,807 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:55:55,807 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:55,807 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:56,168 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/4d48c2f6d2db4784b5f5d32389313b6d 2023-11-12 00:55:56,172 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/7d5babe9fd2d42d596f78982bc0eb07e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/7d5babe9fd2d42d596f78982bc0eb07e 2023-11-12 00:55:56,205 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/7d5babe9fd2d42d596f78982bc0eb07e, entries=4, sequenceid=5, filesize=5.5 K 2023-11-12 00:55:56,206 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/4d48c2f6d2db4784b5f5d32389313b6d as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/4d48c2f6d2db4784b5f5d32389313b6d 2023-11-12 00:55:56,209 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/4d48c2f6d2db4784b5f5d32389313b6d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-12 00:55:56,210 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6f10f9ddb9807fd2fa78c148dd070a57 in 1357ms, sequenceid=5, compaction requested=false 2023-11-12 00:55:56,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:55:56,210 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:56,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:56,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:56,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-12 00:55:56,210 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-12 00:55:56,213 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:56,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:56,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:56,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-12 00:55:56,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ceeb52[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:56,214 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-12 00:55:56,214 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,216 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-12 00:55:56,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-12 00:55:56,216 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:56,216 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,216 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:56,217 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,217 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-12 00:55:56,218 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,218 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-12 00:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:56,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-12 00:55:56,220 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-12 00:55:56,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:56,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:56,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-12 00:55:56,220 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:56,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:56,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,227 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:56,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:56,228 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:56,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:56,229 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:56,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:56,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:56,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:56,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-12 00:55:56,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-12 00:55:56,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:56,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:56,232 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:56,232 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:56,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:56,332 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:56,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:56,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:56,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:56,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:56,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:56,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:56,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-12 00:55:56,339 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-12 00:55:56,339 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:56,339 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-12 00:55:56,339 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-12 00:55:56,340 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,340 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:56,341 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,341 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:56,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:56,341 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:56,342 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:56,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:56,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:56,342 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-12 00:55:56,343 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-12 00:55:56,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-12 00:55:56,343 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-12 00:55:56,343 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:56,343 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-12 00:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. started... 2023-11-12 00:55:56,343 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:56,343 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. started... 2023-11-12 00:55:56,343 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. started... 2023-11-12 00:55:56,343 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:56,343 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f10f9ddb9807fd2fa78c148dd070a57 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:56,343 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b0b9775d0ec55d580d7732f12aa5fda9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-12 00:55:56,797 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311123fdd982ad07d4c978fb8d882a1badd39 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311123fdd982ad07d4c978fb8d882a1badd39 2023-11-12 00:55:56,797 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112a81efb570e12439faead56287886374c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a81efb570e12439faead56287886374c 2023-11-12 00:55:56,800 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111208225672311a4bc0a1396b9bf2657230 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111208225672311a4bc0a1396b9bf2657230 2023-11-12 00:55:57,215 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/6d41980813594dc68d091fa6030ce26b 2023-11-12 00:55:57,217 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/1d3d8b6b4e214c62b2f2eb4001685957 2023-11-12 00:55:57,218 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/9c8d1ae3ecd048cf8f15b5141d2cea37 2023-11-12 00:55:57,268 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311121ce563037e4546c29f7cc93fecb1dcc1 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311121ce563037e4546c29f7cc93fecb1dcc1 2023-11-12 00:55:57,274 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/e09e3dfc8b00461db9157ce191a54712 2023-11-12 00:55:57,276 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112fb1840b5783a4532a4aa61e51fd26420 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231112fb1840b5783a4532a4aa61e51fd26420 2023-11-12 00:55:57,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/9c8d1ae3ecd048cf8f15b5141d2cea37 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9c8d1ae3ecd048cf8f15b5141d2cea37 2023-11-12 00:55:57,280 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/4eeec0513ff546af871ea0b0f8994bf7 2023-11-12 00:55:57,283 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/6d41980813594dc68d091fa6030ce26b as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/6d41980813594dc68d091fa6030ce26b 2023-11-12 00:55:57,310 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9c8d1ae3ecd048cf8f15b5141d2cea37, entries=4, sequenceid=9, filesize=5.5 K 2023-11-12 00:55:57,311 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/e09e3dfc8b00461db9157ce191a54712 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/e09e3dfc8b00461db9157ce191a54712 2023-11-12 00:55:57,313 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/6d41980813594dc68d091fa6030ce26b, entries=4, sequenceid=9, filesize=5.5 K 2023-11-12 00:55:57,314 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/e09e3dfc8b00461db9157ce191a54712, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:57,314 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/4eeec0513ff546af871ea0b0f8994bf7 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/4eeec0513ff546af871ea0b0f8994bf7 2023-11-12 00:55:57,315 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6f10f9ddb9807fd2fa78c148dd070a57 in 972ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:57,315 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:55:57,315 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:57,315 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:57,317 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/4eeec0513ff546af871ea0b0f8994bf7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:57,318 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b0b9775d0ec55d580d7732f12aa5fda9 in 975ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:57,318 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:55:57,318 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:57,318 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:57,657 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311124cfe4851e0e34ed8a446ca5a9f240d90 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311124cfe4851e0e34ed8a446ca5a9f240d90 2023-11-12 00:55:58,062 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/558aa67d0ebb43bd99b191280b9c4b9c 2023-11-12 00:55:58,066 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/1d3d8b6b4e214c62b2f2eb4001685957 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/1d3d8b6b4e214c62b2f2eb4001685957 2023-11-12 00:55:58,089 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/1d3d8b6b4e214c62b2f2eb4001685957, entries=4, sequenceid=9, filesize=5.5 K 2023-11-12 00:55:58,090 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/558aa67d0ebb43bd99b191280b9c4b9c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/558aa67d0ebb43bd99b191280b9c4b9c 2023-11-12 00:55:58,094 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/558aa67d0ebb43bd99b191280b9c4b9c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-12 00:55:58,095 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a42ba8bcf7a2d17d2a9e3b6bc8cc432e in 1752ms, sequenceid=9, compaction requested=false 2023-11-12 00:55:58,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:55:58,095 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-12 00:55:58,095 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-12 00:55:58,096 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,097 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:58,097 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,097 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:58,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-12 00:55:58,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@365723f7[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:58,098 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-12 00:55:58,098 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,101 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-12 00:55:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-12 00:55:58,101 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:58,101 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,101 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:58,102 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,102 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-12 00:55:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:58,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:58,102 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:58,102 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-12 00:55:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:58,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:58,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:58,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:58,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-12 00:55:58,105 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-12 00:55:58,105 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:58,105 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:58,105 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-12 00:55:58,105 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:58,106 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,106 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,106 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:58,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:58,107 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:58,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:58,108 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:58,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,110 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:58,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-12 00:55:58,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:58,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:58,110 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:58,111 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:58,111 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:58,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-12 00:55:58,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:58,111 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:58,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:58,111 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,211 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:58,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:58,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:58,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:58,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:58,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:58,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:58,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-12 00:55:58,217 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-12 00:55:58,217 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:58,217 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-12 00:55:58,217 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-12 00:55:58,218 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,218 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:58,220 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:58,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:58,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:58,220 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:58,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:58,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:58,221 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-12 00:55:58,221 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-12 00:55:58,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-12 00:55:58,221 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-12 00:55:58,221 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:58,221 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-12 00:55:58,222 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:58,222 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:58,222 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:58,222 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:58,222 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:58,222 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. started... 2023-11-12 00:55:58,222 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. started... 2023-11-12 00:55:58,222 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. started... 2023-11-12 00:55:58,222 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:58,222 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b0b9775d0ec55d580d7732f12aa5fda9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:58,222 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f10f9ddb9807fd2fa78c148dd070a57 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-12 00:55:58,254 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:55:58,254 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1be38d19 to 127.0.0.1:60532 2023-11-12 00:55:58,255 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:58,255 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:55:58,255 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ec5bc2b to 127.0.0.1:60532 2023-11-12 00:55:58,255 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:55:58,292 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311125ade0b7efdd0431bab6850e4742a9540 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311125ade0b7efdd0431bab6850e4742a9540 2023-11-12 00:55:58,697 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311127b1d4acb7d484400b0e115b70b220ca4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311127b1d4acb7d484400b0e115b70b220ca4 2023-11-12 00:55:58,697 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311121dfdbac7d19045a2a4f940cb6965af58 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311121dfdbac7d19045a2a4f940cb6965af58 2023-11-12 00:55:58,706 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/c496231efede4a5995940f750b6729f3 2023-11-12 00:55:58,719 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6 2023-11-12 00:55:58,743 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311127daa9569fff34143b536eac8d0327e5f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311127daa9569fff34143b536eac8d0327e5f 2023-11-12 00:55:59,119 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/a79a6919903a48f2831def3742ea2bbe 2023-11-12 00:55:59,149 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/d1bb472006ac4f8b81d66dab68d9e05e 2023-11-12 00:55:59,154 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111296be81944ec8487e9721853a26f21bc4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023111296be81944ec8487e9721853a26f21bc4 2023-11-12 00:55:59,156 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/c496231efede4a5995940f750b6729f3 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/c496231efede4a5995940f750b6729f3 2023-11-12 00:55:59,157 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111212027fc395fd4f759c373b45ad892764 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111212027fc395fd4f759c373b45ad892764 2023-11-12 00:55:59,180 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/c496231efede4a5995940f750b6729f3, entries=4, sequenceid=13, filesize=5.5 K 2023-11-12 00:55:59,181 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/d1bb472006ac4f8b81d66dab68d9e05e as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/d1bb472006ac4f8b81d66dab68d9e05e 2023-11-12 00:55:59,184 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/d1bb472006ac4f8b81d66dab68d9e05e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:59,184 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b0b9775d0ec55d580d7732f12aa5fda9 in 962ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:59,184 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:55:59,184 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:59,185 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:55:59,567 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/0018b298d40f40df88c0385f56635d0b 2023-11-12 00:55:59,567 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/511d1247acef4798919304fccff1fa10 2023-11-12 00:55:59,571 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6 2023-11-12 00:55:59,571 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/a79a6919903a48f2831def3742ea2bbe as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/a79a6919903a48f2831def3742ea2bbe 2023-11-12 00:55:59,594 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6, entries=4, sequenceid=13, filesize=5.5 K 2023-11-12 00:55:59,594 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/a79a6919903a48f2831def3742ea2bbe, entries=4, sequenceid=13, filesize=5.5 K 2023-11-12 00:55:59,595 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/0018b298d40f40df88c0385f56635d0b as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/0018b298d40f40df88c0385f56635d0b 2023-11-12 00:55:59,595 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/511d1247acef4798919304fccff1fa10 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/511d1247acef4798919304fccff1fa10 2023-11-12 00:55:59,600 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/511d1247acef4798919304fccff1fa10, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:59,600 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/0018b298d40f40df88c0385f56635d0b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-12 00:55:59,600 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a42ba8bcf7a2d17d2a9e3b6bc8cc432e in 1378ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:59,600 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6f10f9ddb9807fd2fa78c148dd070a57 in 1378ms, sequenceid=13, compaction requested=true 2023-11-12 00:55:59,600 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:55:59,601 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:55:59,601 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:59,601 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:55:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:55:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:55:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-12 00:55:59,601 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-12 00:55:59,603 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,603 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:59,603 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,603 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:55:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:59,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:59,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:59,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-12 00:55:59,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f4a16a0[Count = 0] remaining members to acquire global barrier 2023-11-12 00:55:59,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-12 00:55:59,604 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,606 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,606 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-12 00:55:59,607 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-12 00:55:59,607 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:55:59,607 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,607 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:55:59,608 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-12 00:55:59,608 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,608 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,608 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-12 00:55:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:59,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:55:59,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-12 00:55:59,610 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-12 00:55:59,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:55:59,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:55:59,610 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-12 00:55:59,610 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:55:59,612 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,612 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,612 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:55:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:55:59,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:55:59,612 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:55:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:59,614 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:55:59,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:55:59,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,616 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,616 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:55:59,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,617 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:55:59,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-12 00:55:59,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:59,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-12 00:55:59,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-12 00:55:59,617 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:55:59,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:55:59,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:55:59,717 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:55:59,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:55:59,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:59,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:59,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. with WAL disabled. Data may be lost in the event of a crash. 2023-11-12 00:55:59,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:55:59,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-12 00:55:59,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-12 00:55:59,724 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-12 00:55:59,724 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:59,724 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-12 00:55:59,724 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-12 00:55:59,725 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,725 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:59,728 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:55:59,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:55:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:55:59,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:55:59,728 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:55:59,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:59,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:55:59,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:55:59,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:55:59,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-12 00:55:59,729 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-12 00:55:59,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-12 00:55:59,730 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-12 00:55:59,730 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:55:59,730 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-12 00:55:59,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:55:59,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. started... 2023-11-12 00:55:59,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:55:59,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:55:59,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. started... 2023-11-12 00:55:59,730 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:55:59,730 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:55:59,730 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. started... 2023-11-12 00:55:59,730 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f10f9ddb9807fd2fa78c148dd070a57 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:59,730 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b0b9775d0ec55d580d7732f12aa5fda9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:59,730 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-12 00:55:59,779 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112670fe9a3feda40dd838c52750b2fbd97 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112670fe9a3feda40dd838c52750b2fbd97 2023-11-12 00:55:59,790 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311121bf83037907e44469c9489b384df07e4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311121bf83037907e44469c9489b384df07e4 2023-11-12 00:55:59,793 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce 2023-11-12 00:55:59,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-12 00:56:00,183 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111202ac746ed7164952b553244c01bb9ac6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111202ac746ed7164952b553244c01bb9ac6 2023-11-12 00:56:00,209 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/25d2f649f72f497fb1430838909f447c 2023-11-12 00:56:00,229 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112f40c622e2ec0437aa28094ab1885e5b8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231112f40c622e2ec0437aa28094ab1885e5b8 2023-11-12 00:56:00,238 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/af934e0381df4f0b956e19ebb41d1933 2023-11-12 00:56:00,242 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce 2023-11-12 00:56:00,242 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111201f733ddd28346d79472fc51e3608bf0 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023111201f733ddd28346d79472fc51e3608bf0 2023-11-12 00:56:00,246 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/5370791c6a5840539fa5361f4c87c865 2023-11-12 00:56:00,250 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/25d2f649f72f497fb1430838909f447c as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/25d2f649f72f497fb1430838909f447c 2023-11-12 00:56:00,272 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce, entries=4, sequenceid=17, filesize=5.5 K 2023-11-12 00:56:00,272 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/25d2f649f72f497fb1430838909f447c, entries=4, sequenceid=17, filesize=5.5 K 2023-11-12 00:56:00,272 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/af934e0381df4f0b956e19ebb41d1933 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/af934e0381df4f0b956e19ebb41d1933 2023-11-12 00:56:00,273 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/5370791c6a5840539fa5361f4c87c865 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/5370791c6a5840539fa5361f4c87c865 2023-11-12 00:56:00,277 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/5370791c6a5840539fa5361f4c87c865, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:56:00,278 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/af934e0381df4f0b956e19ebb41d1933, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:56:00,278 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6f10f9ddb9807fd2fa78c148dd070a57 in 548ms, sequenceid=17, compaction requested=true 2023-11-12 00:56:00,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:56:00,278 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:00,278 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:56:00,281 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b0b9775d0ec55d580d7732f12aa5fda9 in 551ms, sequenceid=17, compaction requested=true 2023-11-12 00:56:00,281 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:56:00,281 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:00,281 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:56:00,597 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/2873c12e999e4b5d974b3b07afe82afd 2023-11-12 00:56:01,029 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231112ef78c9a1869d4f65baf8c47d7abdeba9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231112ef78c9a1869d4f65baf8c47d7abdeba9 2023-11-12 00:56:01,434 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/650ed5d7786c4b308bf88d5ec05ecccc 2023-11-12 00:56:01,438 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/2873c12e999e4b5d974b3b07afe82afd as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/2873c12e999e4b5d974b3b07afe82afd 2023-11-12 00:56:01,461 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/2873c12e999e4b5d974b3b07afe82afd, entries=4, sequenceid=17, filesize=5.5 K 2023-11-12 00:56:01,462 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/650ed5d7786c4b308bf88d5ec05ecccc as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/650ed5d7786c4b308bf88d5ec05ecccc 2023-11-12 00:56:01,465 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/650ed5d7786c4b308bf88d5ec05ecccc, entries=2, sequenceid=17, filesize=5.1 K 2023-11-12 00:56:01,466 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a42ba8bcf7a2d17d2a9e3b6bc8cc432e in 1736ms, sequenceid=17, compaction requested=true 2023-11-12 00:56:01,466 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:56:01,466 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:01,466 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:56:01,466 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:56:01,466 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,466 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-12 00:56:01,466 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-12 00:56:01,468 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:56:01,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:56:01,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,468 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:56:01,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:56:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:56:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:56:01,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-12 00:56:01,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310e30c9[Count = 0] remaining members to acquire global barrier 2023-11-12 00:56:01,470 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-12 00:56:01,470 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,475 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,475 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-12 00:56:01,475 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-12 00:56:01,475 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:56:01,475 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,475 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:56:01,477 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,477 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-12 00:56:01,477 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:56:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:56:01,477 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-12 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:56:01,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:01,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:56:01,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-12 00:56:01,479 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-12 00:56:01,479 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:56:01,479 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:56:01,480 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-12 00:56:01,480 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:56:01,481 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,481 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:56:01,481 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:56:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:56:01,482 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:56:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,483 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:56:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:56:01,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-12 00:56:01,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-12 00:56:01,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:56:01,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:56:01,486 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:01,486 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:56:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:56:01,586 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:56:01,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:56:01,595 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:56:01,601 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:56:01,608 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:56:01,608 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:56:01,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-12 00:56:01,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-12 00:56:01,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-12 00:56:01,688 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-12 00:56:01,688 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:56:01,688 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-12 00:56:01,688 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-12 00:56:01,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,689 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:01,690 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,690 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:56:01,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:56:01,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:56:01,690 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:01,690 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-12 00:56:01,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:01,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:01,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-12 00:56:01,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:01,691 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-12 00:56:01,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-12 00:56:01,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-12 00:56:01,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-12 00:56:01,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-12 00:56:01,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-12 00:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:01,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-12 00:56:01,693 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-12 00:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. started... 2023-11-12 00:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. started... 2023-11-12 00:56:01,693 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6f10f9ddb9807fd2fa78c148dd070a57 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:56:01,693 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. started... 2023-11-12 00:56:01,694 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b0b9775d0ec55d580d7732f12aa5fda9 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:56:01,694 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-12 00:56:02,138 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/8d80d1052c714132b61fdad3f2763118 2023-11-12 00:56:02,140 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/02022d8b344e4f0b94541e658b14d3f6 2023-11-12 00:56:02,168 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d80d1052c714132b61fdad3f2763118 2023-11-12 00:56:02,168 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02022d8b344e4f0b94541e658b14d3f6 2023-11-12 00:56:02,535 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/9e68da96950741e198317b2b8cd73bdb 2023-11-12 00:56:02,572 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e68da96950741e198317b2b8cd73bdb 2023-11-12 00:56:02,580 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/a49740725afb423b8f1ecf3e31d03eec 2023-11-12 00:56:02,583 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a49740725afb423b8f1ecf3e31d03eec 2023-11-12 00:56:02,584 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/02022d8b344e4f0b94541e658b14d3f6 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/02022d8b344e4f0b94541e658b14d3f6 2023-11-12 00:56:02,606 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02022d8b344e4f0b94541e658b14d3f6 2023-11-12 00:56:02,606 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/02022d8b344e4f0b94541e658b14d3f6, entries=3, sequenceid=23, filesize=5.2 K 2023-11-12 00:56:02,607 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/a49740725afb423b8f1ecf3e31d03eec as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/a49740725afb423b8f1ecf3e31d03eec 2023-11-12 00:56:02,610 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a49740725afb423b8f1ecf3e31d03eec 2023-11-12 00:56:02,610 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/a49740725afb423b8f1ecf3e31d03eec, entries=1, sequenceid=23, filesize=5.0 K 2023-11-12 00:56:02,611 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b0b9775d0ec55d580d7732f12aa5fda9 in 917ms, sequenceid=23, compaction requested=true 2023-11-12 00:56:02,611 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:56:02,611 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:02,611 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-12 00:56:02,981 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/b4c75f69e240423bbb5fdcd01988b2f4 2023-11-12 00:56:02,985 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4c75f69e240423bbb5fdcd01988b2f4 2023-11-12 00:56:02,985 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/ddccab602425408abb0068ea31d9157f 2023-11-12 00:56:02,986 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/8d80d1052c714132b61fdad3f2763118 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/8d80d1052c714132b61fdad3f2763118 2023-11-12 00:56:02,989 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddccab602425408abb0068ea31d9157f 2023-11-12 00:56:02,990 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/9e68da96950741e198317b2b8cd73bdb as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9e68da96950741e198317b2b8cd73bdb 2023-11-12 00:56:03,010 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d80d1052c714132b61fdad3f2763118 2023-11-12 00:56:03,010 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/8d80d1052c714132b61fdad3f2763118, entries=3, sequenceid=23, filesize=5.2 K 2023-11-12 00:56:03,010 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/b4c75f69e240423bbb5fdcd01988b2f4 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/b4c75f69e240423bbb5fdcd01988b2f4 2023-11-12 00:56:03,014 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e68da96950741e198317b2b8cd73bdb 2023-11-12 00:56:03,014 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9e68da96950741e198317b2b8cd73bdb, entries=3, sequenceid=23, filesize=5.2 K 2023-11-12 00:56:03,015 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/ddccab602425408abb0068ea31d9157f as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/ddccab602425408abb0068ea31d9157f 2023-11-12 00:56:03,016 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4c75f69e240423bbb5fdcd01988b2f4 2023-11-12 00:56:03,016 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/b4c75f69e240423bbb5fdcd01988b2f4, entries=1, sequenceid=23, filesize=5.0 K 2023-11-12 00:56:03,016 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a42ba8bcf7a2d17d2a9e3b6bc8cc432e in 1322ms, sequenceid=23, compaction requested=true 2023-11-12 00:56:03,016 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:56:03,017 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:03,017 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-12 00:56:03,018 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddccab602425408abb0068ea31d9157f 2023-11-12 00:56:03,018 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/ddccab602425408abb0068ea31d9157f, entries=1, sequenceid=23, filesize=5.0 K 2023-11-12 00:56:03,019 INFO [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6f10f9ddb9807fd2fa78c148dd070a57 in 1326ms, sequenceid=23, compaction requested=true 2023-11-12 00:56:03,019 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:56:03,019 DEBUG [rs(jenkins-hbase4.apache.org,43681,1699750400629)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-12 00:56:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-12 00:56:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-12 00:56:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-12 00:56:03,021 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,021 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:56:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:56:03,021 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:56:03,021 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-12 00:56:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:56:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:56:03,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43681,1699750400629' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-12 00:56:03,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456ec9c1[Count = 0] remaining members to acquire global barrier 2023-11-12 00:56:03,023 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-12 00:56:03,023 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,024 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,024 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-12 00:56:03,024 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-12 00:56:03,024 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43681,1699750400629' in zk 2023-11-12 00:56:03,024 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,024 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-12 00:56:03,025 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,025 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-12 00:56:03,025 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:56:03,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:56:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:56:03,025 DEBUG [member: 'jenkins-hbase4.apache.org,43681,1699750400629' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-12 00:56:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:56:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:56:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:56:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43681,1699750400629': 2023-11-12 00:56:03,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43681,1699750400629' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-12 00:56:03,028 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-12 00:56:03,028 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-12 00:56:03,028 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-12 00:56:03,028 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-12 00:56:03,028 INFO [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-12 00:56:03,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-12 00:56:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-12 00:56:03,030 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:56:03,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-12 00:56:03,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:56:03,031 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:56:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-12 00:56:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,032 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-12 00:56:03,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-12 00:56:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-12 00:56:03,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:03,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-12 00:56:03,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-12 00:56:03,034 DEBUG [(jenkins-hbase4.apache.org,41743,1699750399446)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-12 00:56:03,034 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-12 00:56:03,035 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-12 00:56:03,035 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-12 00:56:03,035 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-12 00:56:03,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-12 00:56:03,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-12 00:56:03,135 DEBUG [Listener at localhost/40343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-12 00:56:03,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41743] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-12 00:56:03,136 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:56:03,136 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 6f10f9ddb9807fd2fa78c148dd070a57/family1 is initiating major compaction (all files) 2023-11-12 00:56:03,136 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:56:03,136 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:56:03,136 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 6f10f9ddb9807fd2fa78c148dd070a57/family1 in testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:03,137 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/7d5babe9fd2d42d596f78982bc0eb07e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9c8d1ae3ecd048cf8f15b5141d2cea37, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/a79a6919903a48f2831def3742ea2bbe, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/25d2f649f72f497fb1430838909f447c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9e68da96950741e198317b2b8cd73bdb] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp, totalSize=27.1 K 2023-11-12 00:56:03,137 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 7d5babe9fd2d42d596f78982bc0eb07e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750554833 2023-11-12 00:56:03,137 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 9c8d1ae3ecd048cf8f15b5141d2cea37, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750556334 2023-11-12 00:56:03,138 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting a79a6919903a48f2831def3742ea2bbe, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750558213 2023-11-12 00:56:03,138 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 25d2f649f72f497fb1430838909f447c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750559720 2023-11-12 00:56:03,138 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 9e68da96950741e198317b2b8cd73bdb, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:56:03,149 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 6f10f9ddb9807fd2fa78c148dd070a57#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:56:03,587 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del 2023-11-12 00:56:03,587 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del 2023-11-12 00:56:04,451 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77b4c3c0681e415d89a508ff339a3f99 2023-11-12 00:56:04,451 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family1/77b4c3c0681e415d89a508ff339a3f99 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/77b4c3c0681e415d89a508ff339a3f99 2023-11-12 00:56:04,472 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77b4c3c0681e415d89a508ff339a3f99 2023-11-12 00:56:04,473 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6f10f9ddb9807fd2fa78c148dd070a57/family1 of 6f10f9ddb9807fd2fa78c148dd070a57 into 77b4c3c0681e415d89a508ff339a3f99(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:56:04,474 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:56:04,474 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:56:04,474 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): 6f10f9ddb9807fd2fa78c148dd070a57/family2 is initiating major compaction (all files) 2023-11-12 00:56:04,474 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:56:04,474 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:56:04,474 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of 6f10f9ddb9807fd2fa78c148dd070a57/family2 in testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:04,474 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/4d48c2f6d2db4784b5f5d32389313b6d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/e09e3dfc8b00461db9157ce191a54712, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/511d1247acef4798919304fccff1fa10, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/5370791c6a5840539fa5361f4c87c865, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/ddccab602425408abb0068ea31d9157f] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp, totalSize=25.4 K 2023-11-12 00:56:04,474 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 4d48c2f6d2db4784b5f5d32389313b6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750554833 2023-11-12 00:56:04,475 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting e09e3dfc8b00461db9157ce191a54712, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750556334 2023-11-12 00:56:04,475 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 511d1247acef4798919304fccff1fa10, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750558213 2023-11-12 00:56:04,475 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 5370791c6a5840539fa5361f4c87c865, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750559720 2023-11-12 00:56:04,476 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting ddccab602425408abb0068ea31d9157f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:56:04,483 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): 6f10f9ddb9807fd2fa78c148dd070a57#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:56:04,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/7d5babe9fd2d42d596f78982bc0eb07e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9c8d1ae3ecd048cf8f15b5141d2cea37, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/a79a6919903a48f2831def3742ea2bbe, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/25d2f649f72f497fb1430838909f447c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9e68da96950741e198317b2b8cd73bdb] to archive 2023-11-12 00:56:04,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:04,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/7d5babe9fd2d42d596f78982bc0eb07e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/7d5babe9fd2d42d596f78982bc0eb07e 2023-11-12 00:56:04,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9c8d1ae3ecd048cf8f15b5141d2cea37 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9c8d1ae3ecd048cf8f15b5141d2cea37 2023-11-12 00:56:04,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/a79a6919903a48f2831def3742ea2bbe to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/a79a6919903a48f2831def3742ea2bbe 2023-11-12 00:56:04,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/25d2f649f72f497fb1430838909f447c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/25d2f649f72f497fb1430838909f447c 2023-11-12 00:56:04,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9e68da96950741e198317b2b8cd73bdb to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/9e68da96950741e198317b2b8cd73bdb 2023-11-12 00:56:04,892 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311122ea4713725154c6997c0a120ee6ce067_del 2023-11-12 00:56:04,892 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311122ea4713725154c6997c0a120ee6ce067_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311122ea4713725154c6997c0a120ee6ce067_del 2023-11-12 00:56:05,704 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f412c83bc39b4ac78da70c1e956a4071 2023-11-12 00:56:05,704 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/.tmp/family2/f412c83bc39b4ac78da70c1e956a4071 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/f412c83bc39b4ac78da70c1e956a4071 2023-11-12 00:56:05,707 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f412c83bc39b4ac78da70c1e956a4071 2023-11-12 00:56:05,708 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6f10f9ddb9807fd2fa78c148dd070a57/family2 of 6f10f9ddb9807fd2fa78c148dd070a57 into f412c83bc39b4ac78da70c1e956a4071(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:56:05,708 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:56:05,708 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:56:05,708 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 is initiating major compaction (all files) 2023-11-12 00:56:05,709 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:56:05,709 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:56:05,709 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 in testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:05,709 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/46cb907aec4a440eae06f7256fec4467, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/1d3d8b6b4e214c62b2f2eb4001685957, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/2873c12e999e4b5d974b3b07afe82afd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/8d80d1052c714132b61fdad3f2763118] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp, totalSize=27.1 K 2023-11-12 00:56:05,709 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 46cb907aec4a440eae06f7256fec4467, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750554834 2023-11-12 00:56:05,710 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 1d3d8b6b4e214c62b2f2eb4001685957, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750556335 2023-11-12 00:56:05,710 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting a9bfcf56c3ee4ca292b0f51309a0e2b6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750558213 2023-11-12 00:56:05,710 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 2873c12e999e4b5d974b3b07afe82afd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750559720 2023-11-12 00:56:05,711 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 8d80d1052c714132b61fdad3f2763118, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:56:05,718 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): a42ba8bcf7a2d17d2a9e3b6bc8cc432e#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:56:05,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/4d48c2f6d2db4784b5f5d32389313b6d, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/e09e3dfc8b00461db9157ce191a54712, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/511d1247acef4798919304fccff1fa10, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/5370791c6a5840539fa5361f4c87c865, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/ddccab602425408abb0068ea31d9157f] to archive 2023-11-12 00:56:05,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:05,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/4d48c2f6d2db4784b5f5d32389313b6d to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/4d48c2f6d2db4784b5f5d32389313b6d 2023-11-12 00:56:05,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/e09e3dfc8b00461db9157ce191a54712 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/e09e3dfc8b00461db9157ce191a54712 2023-11-12 00:56:05,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/511d1247acef4798919304fccff1fa10 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/511d1247acef4798919304fccff1fa10 2023-11-12 00:56:05,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/5370791c6a5840539fa5361f4c87c865 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/5370791c6a5840539fa5361f4c87c865 2023-11-12 00:56:05,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/ddccab602425408abb0068ea31d9157f to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family2/ddccab602425408abb0068ea31d9157f 2023-11-12 00:56:06,157 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del 2023-11-12 00:56:06,157 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del 2023-11-12 00:56:07,009 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a90aeee6fae4b86ad42841de5321ab5 2023-11-12 00:56:07,010 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family1/5a90aeee6fae4b86ad42841de5321ab5 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/5a90aeee6fae4b86ad42841de5321ab5 2023-11-12 00:56:07,031 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a90aeee6fae4b86ad42841de5321ab5 2023-11-12 00:56:07,032 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 of a42ba8bcf7a2d17d2a9e3b6bc8cc432e into 5a90aeee6fae4b86ad42841de5321ab5(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:56:07,032 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:56:07,032 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:56:07,032 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2 is initiating major compaction (all files) 2023-11-12 00:56:07,032 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:56:07,032 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:56:07,034 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2 in testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:07,034 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/7d27c8ee89ee46108b9498ce7bed3952, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/558aa67d0ebb43bd99b191280b9c4b9c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/0018b298d40f40df88c0385f56635d0b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/650ed5d7786c4b308bf88d5ec05ecccc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/b4c75f69e240423bbb5fdcd01988b2f4] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp, totalSize=25.4 K 2023-11-12 00:56:07,034 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 7d27c8ee89ee46108b9498ce7bed3952, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750554834 2023-11-12 00:56:07,034 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 558aa67d0ebb43bd99b191280b9c4b9c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750556335 2023-11-12 00:56:07,035 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 0018b298d40f40df88c0385f56635d0b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750558213 2023-11-12 00:56:07,035 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 650ed5d7786c4b308bf88d5ec05ecccc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750559720 2023-11-12 00:56:07,035 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting b4c75f69e240423bbb5fdcd01988b2f4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:56:07,043 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): a42ba8bcf7a2d17d2a9e3b6bc8cc432e#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:56:07,128 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/46cb907aec4a440eae06f7256fec4467, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/1d3d8b6b4e214c62b2f2eb4001685957, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/2873c12e999e4b5d974b3b07afe82afd, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/8d80d1052c714132b61fdad3f2763118] to archive 2023-11-12 00:56:07,129 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:07,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/46cb907aec4a440eae06f7256fec4467 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/46cb907aec4a440eae06f7256fec4467 2023-11-12 00:56:07,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/1d3d8b6b4e214c62b2f2eb4001685957 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/1d3d8b6b4e214c62b2f2eb4001685957 2023-11-12 00:56:07,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/a9bfcf56c3ee4ca292b0f51309a0e2b6 2023-11-12 00:56:07,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/2873c12e999e4b5d974b3b07afe82afd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/2873c12e999e4b5d974b3b07afe82afd 2023-11-12 00:56:07,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/8d80d1052c714132b61fdad3f2763118 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/8d80d1052c714132b61fdad3f2763118 2023-11-12 00:56:07,450 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311122406f43cf375457993efe002f647bf88_del 2023-11-12 00:56:07,450 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311122406f43cf375457993efe002f647bf88_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311122406f43cf375457993efe002f647bf88_del 2023-11-12 00:56:08,264 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5134d3d354b64dbb9edf89fede84e7ac 2023-11-12 00:56:08,264 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/.tmp/family2/5134d3d354b64dbb9edf89fede84e7ac as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/5134d3d354b64dbb9edf89fede84e7ac 2023-11-12 00:56:08,268 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5134d3d354b64dbb9edf89fede84e7ac 2023-11-12 00:56:08,268 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2 of a42ba8bcf7a2d17d2a9e3b6bc8cc432e into 5134d3d354b64dbb9edf89fede84e7ac(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:56:08,269 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:56:08,269 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:56:08,269 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): b0b9775d0ec55d580d7732f12aa5fda9/family1 is initiating major compaction (all files) 2023-11-12 00:56:08,269 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:56:08,269 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:56:08,269 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of b0b9775d0ec55d580d7732f12aa5fda9/family1 in testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:08,269 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/7edc2fd0baca4accb6850cb5bccc18e4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/6d41980813594dc68d091fa6030ce26b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/c496231efede4a5995940f750b6729f3, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/02022d8b344e4f0b94541e658b14d3f6] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp, totalSize=27.1 K 2023-11-12 00:56:08,269 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 7edc2fd0baca4accb6850cb5bccc18e4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750554834 2023-11-12 00:56:08,270 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 6d41980813594dc68d091fa6030ce26b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750556335 2023-11-12 00:56:08,270 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting c496231efede4a5995940f750b6729f3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750558213 2023-11-12 00:56:08,270 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 0ca6f9abb1cc4e5b9206e0b9334af1ce, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750559720 2023-11-12 00:56:08,270 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 02022d8b344e4f0b94541e658b14d3f6, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:56:08,278 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): b0b9775d0ec55d580d7732f12aa5fda9#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:56:08,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/7d27c8ee89ee46108b9498ce7bed3952, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/558aa67d0ebb43bd99b191280b9c4b9c, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/0018b298d40f40df88c0385f56635d0b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/650ed5d7786c4b308bf88d5ec05ecccc, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/b4c75f69e240423bbb5fdcd01988b2f4] to archive 2023-11-12 00:56:08,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:08,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/7d27c8ee89ee46108b9498ce7bed3952 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/7d27c8ee89ee46108b9498ce7bed3952 2023-11-12 00:56:08,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/558aa67d0ebb43bd99b191280b9c4b9c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/558aa67d0ebb43bd99b191280b9c4b9c 2023-11-12 00:56:08,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/0018b298d40f40df88c0385f56635d0b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/0018b298d40f40df88c0385f56635d0b 2023-11-12 00:56:08,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/650ed5d7786c4b308bf88d5ec05ecccc to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/650ed5d7786c4b308bf88d5ec05ecccc 2023-11-12 00:56:08,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/b4c75f69e240423bbb5fdcd01988b2f4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family2/b4c75f69e240423bbb5fdcd01988b2f4 2023-11-12 00:56:08,714 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del 2023-11-12 00:56:08,714 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del 2023-11-12 00:56:09,175 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4306f505077427caf1dceb63d92ff39 2023-11-12 00:56:09,176 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family1/e4306f505077427caf1dceb63d92ff39 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/e4306f505077427caf1dceb63d92ff39 2023-11-12 00:56:09,198 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4306f505077427caf1dceb63d92ff39 2023-11-12 00:56:09,199 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b0b9775d0ec55d580d7732f12aa5fda9/family1 of b0b9775d0ec55d580d7732f12aa5fda9 into e4306f505077427caf1dceb63d92ff39(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-12 00:56:09,199 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:56:09,199 DEBUG [Listener at localhost/40343] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-12 00:56:09,199 DEBUG [Listener at localhost/40343] regionserver.HStore(1912): b0b9775d0ec55d580d7732f12aa5fda9/family2 is initiating major compaction (all files) 2023-11-12 00:56:09,199 INFO [Listener at localhost/40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-12 00:56:09,199 INFO [Listener at localhost/40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-12 00:56:09,199 INFO [Listener at localhost/40343] regionserver.HRegion(2259): Starting compaction of b0b9775d0ec55d580d7732f12aa5fda9/family2 in testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:09,199 INFO [Listener at localhost/40343] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/496f766de78048a396212d5939074c70, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/4eeec0513ff546af871ea0b0f8994bf7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/d1bb472006ac4f8b81d66dab68d9e05e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/af934e0381df4f0b956e19ebb41d1933, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/a49740725afb423b8f1ecf3e31d03eec] into tmpdir=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp, totalSize=25.4 K 2023-11-12 00:56:09,200 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 496f766de78048a396212d5939074c70, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699750554834 2023-11-12 00:56:09,200 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting 4eeec0513ff546af871ea0b0f8994bf7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699750556335 2023-11-12 00:56:09,200 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting d1bb472006ac4f8b81d66dab68d9e05e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699750558213 2023-11-12 00:56:09,201 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting af934e0381df4f0b956e19ebb41d1933, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699750559720 2023-11-12 00:56:09,201 DEBUG [Listener at localhost/40343] compactions.Compactor(207): Compacting a49740725afb423b8f1ecf3e31d03eec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-12 00:56:09,210 INFO [Listener at localhost/40343] throttle.PressureAwareThroughputController(145): b0b9775d0ec55d580d7732f12aa5fda9#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-12 00:56:09,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/7edc2fd0baca4accb6850cb5bccc18e4, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/6d41980813594dc68d091fa6030ce26b, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/c496231efede4a5995940f750b6729f3, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/02022d8b344e4f0b94541e658b14d3f6] to archive 2023-11-12 00:56:09,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:09,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/7edc2fd0baca4accb6850cb5bccc18e4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/7edc2fd0baca4accb6850cb5bccc18e4 2023-11-12 00:56:09,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/6d41980813594dc68d091fa6030ce26b to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/6d41980813594dc68d091fa6030ce26b 2023-11-12 00:56:09,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/c496231efede4a5995940f750b6729f3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/c496231efede4a5995940f750b6729f3 2023-11-12 00:56:09,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/0ca6f9abb1cc4e5b9206e0b9334af1ce 2023-11-12 00:56:09,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/02022d8b344e4f0b94541e658b14d3f6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/02022d8b344e4f0b94541e658b14d3f6 2023-11-12 00:56:09,617 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112a95f4d82bae74de4a995503c3a395848_del 2023-11-12 00:56:09,617 INFO [Listener at localhost/40343] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112a95f4d82bae74de4a995503c3a395848_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231112a95f4d82bae74de4a995503c3a395848_del 2023-11-12 00:56:10,430 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac2e68df769a4c9b8c7c53c6c8202340 2023-11-12 00:56:10,430 DEBUG [Listener at localhost/40343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/.tmp/family2/ac2e68df769a4c9b8c7c53c6c8202340 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/ac2e68df769a4c9b8c7c53c6c8202340 2023-11-12 00:56:10,433 INFO [Listener at localhost/40343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac2e68df769a4c9b8c7c53c6c8202340 2023-11-12 00:56:10,434 INFO [Listener at localhost/40343] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b0b9775d0ec55d580d7732f12aa5fda9/family2 of b0b9775d0ec55d580d7732f12aa5fda9 into ac2e68df769a4c9b8c7c53c6c8202340(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-12 00:56:10,434 DEBUG [Listener at localhost/40343] regionserver.HRegion(2289): Compaction status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:56:10,437 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:56:10,439 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:56:10,442 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:56:10,443 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:56:10,448 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41743] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xBCkg6\xAC\xB8S\x14\xCA/H"3t\x17\xBF"\x10\xAD\x007\xA1X\xA7(\x80\xCE\x8E\xED\x96\x87\xFA\x02\xA4*\x10\x82J\x17RZT\x95\x86%=\xAD\xEF\x0F\x0E[\xA02\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-12 00:56:10,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-12 00:56:10,469 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-12 00:56:10,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:56:10,469 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699751170469 2023-11-12 00:56:10,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-12 00:56:10,528 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/496f766de78048a396212d5939074c70, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/4eeec0513ff546af871ea0b0f8994bf7, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/d1bb472006ac4f8b81d66dab68d9e05e, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/af934e0381df4f0b956e19ebb41d1933, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/a49740725afb423b8f1ecf3e31d03eec] to archive 2023-11-12 00:56:10,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:10,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/496f766de78048a396212d5939074c70 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/496f766de78048a396212d5939074c70 2023-11-12 00:56:10,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/4eeec0513ff546af871ea0b0f8994bf7 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/4eeec0513ff546af871ea0b0f8994bf7 2023-11-12 00:56:10,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/d1bb472006ac4f8b81d66dab68d9e05e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/d1bb472006ac4f8b81d66dab68d9e05e 2023-11-12 00:56:10,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/af934e0381df4f0b956e19ebb41d1933 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/af934e0381df4f0b956e19ebb41d1933 2023-11-12 00:56:10,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/a49740725afb423b8f1ecf3e31d03eec to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family2/a49740725afb423b8f1ecf3e31d03eec 2023-11-12 00:56:10,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-12 00:56:10,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del 2023-11-12 00:56:10,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del 2023-11-12 00:56:10,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del 2023-11-12 00:56:10,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:10,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] zookeeper.ReadOnlyZKClient(139): Connect 0x6047122f to 127.0.0.1:60532 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-12 00:56:10,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38a01e83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-12 00:56:10,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231112 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:11,797 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231112f89a6da2e704460c87476bb05abc00d3 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112f89a6da2e704460c87476bb05abc00d3 2023-11-12 00:56:11,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:11,808 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-12 00:56:11,810 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-12 00:56:11,816 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-12 00:56:11,817 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-12 00:56:11,843 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231112/family1/8aa4a3907de9424990c4692510d3bc07 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-12 00:56:11,844 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231112/family1/8aa4a3907de9424990c4692510d3bc07}] 2023-11-12 00:56:11,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231112/family1/8aa4a3907de9424990c4692510d3bc07 for inclusion in b0b9775d0ec55d580d7732f12aa5fda9/family1 2023-11-12 00:56:11,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-12 00:56:11,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-12 00:56:11,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:56:11,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231112/family1/8aa4a3907de9424990c4692510d3bc07 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__25pvc83t9cjmfvfhng2u5hgiefcja9u51q4rfcgpgu6pkgmsgqkm5e1rulaj1fjk/family1/8aa4a3907de9424990c4692510d3bc07 2023-11-12 00:56:11,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__25pvc83t9cjmfvfhng2u5hgiefcja9u51q4rfcgpgu6pkgmsgqkm5e1rulaj1fjk/family1/8aa4a3907de9424990c4692510d3bc07 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/94bac84e595e4c408a6d1ab873cc17e2_SeqId_28_ 2023-11-12 00:56:11,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__25pvc83t9cjmfvfhng2u5hgiefcja9u51q4rfcgpgu6pkgmsgqkm5e1rulaj1fjk/family1/8aa4a3907de9424990c4692510d3bc07 into b0b9775d0ec55d580d7732f12aa5fda9/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/94bac84e595e4c408a6d1ab873cc17e2_SeqId_28_ - updating store file list. 2023-11-12 00:56:11,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/94bac84e595e4c408a6d1ab873cc17e2_SeqId_28_ into b0b9775d0ec55d580d7732f12aa5fda9/family1 2023-11-12 00:56:11,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__25pvc83t9cjmfvfhng2u5hgiefcja9u51q4rfcgpgu6pkgmsgqkm5e1rulaj1fjk/family1/8aa4a3907de9424990c4692510d3bc07 into b0b9775d0ec55d580d7732f12aa5fda9/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/family1/94bac84e595e4c408a6d1ab873cc17e2_SeqId_28_) 2023-11-12 00:56:11,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__25pvc83t9cjmfvfhng2u5hgiefcja9u51q4rfcgpgu6pkgmsgqkm5e1rulaj1fjk/family1/8aa4a3907de9424990c4692510d3bc07 2023-11-12 00:56:11,897 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231112 table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:11,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:11,899 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112468d7e00dc7b43c2a28e0d09366aa2dd to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112468d7e00dc7b43c2a28e0d09366aa2dd 2023-11-12 00:56:11,900 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311125ade0b7efdd0431bab6850e4742a9540 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311125ade0b7efdd0431bab6850e4742a9540 2023-11-12 00:56:11,901 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112670fe9a3feda40dd838c52750b2fbd97 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112670fe9a3feda40dd838c52750b2fbd97 2023-11-12 00:56:11,902 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a81efb570e12439faead56287886374c to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a81efb570e12439faead56287886374c 2023-11-12 00:56:11,902 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-12 00:56:11,902 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231112' 2023-11-12 00:56:11,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231112 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:11,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231112 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:12,056 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311127de7a8125cf540a99698539f95f35ec6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311127de7a8125cf540a99698539f95f35ec6 2023-11-12 00:56:12,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:12,100 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231112/family1/cb440964ef454411bcd7834d99ae86a9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-12 00:56:12,101 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231112/family1/cb440964ef454411bcd7834d99ae86a9}] 2023-11-12 00:56:12,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231112/family1/cb440964ef454411bcd7834d99ae86a9 for inclusion in a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 2023-11-12 00:56:12,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-12 00:56:12,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-12 00:56:12,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:56:12,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231112/family1/cb440964ef454411bcd7834d99ae86a9 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__c4974p5mmamlo0b452j72f3v3i94172slni7evtg5v3lj8iblndifbte1eq274td/family1/cb440964ef454411bcd7834d99ae86a9 2023-11-12 00:56:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__c4974p5mmamlo0b452j72f3v3i94172slni7evtg5v3lj8iblndifbte1eq274td/family1/cb440964ef454411bcd7834d99ae86a9 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/43ceea4ab5ac4db4b9ed8ee229ecc759_SeqId_28_ 2023-11-12 00:56:12,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__c4974p5mmamlo0b452j72f3v3i94172slni7evtg5v3lj8iblndifbte1eq274td/family1/cb440964ef454411bcd7834d99ae86a9 into a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/43ceea4ab5ac4db4b9ed8ee229ecc759_SeqId_28_ - updating store file list. 2023-11-12 00:56:12,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/43ceea4ab5ac4db4b9ed8ee229ecc759_SeqId_28_ into a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 2023-11-12 00:56:12,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__c4974p5mmamlo0b452j72f3v3i94172slni7evtg5v3lj8iblndifbte1eq274td/family1/cb440964ef454411bcd7834d99ae86a9 into a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/family1/43ceea4ab5ac4db4b9ed8ee229ecc759_SeqId_28_) 2023-11-12 00:56:12,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__c4974p5mmamlo0b452j72f3v3i94172slni7evtg5v3lj8iblndifbte1eq274td/family1/cb440964ef454411bcd7834d99ae86a9 2023-11-12 00:56:12,149 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231112 table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:12,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:12,151 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111202ac746ed7164952b553244c01bb9ac6 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111202ac746ed7164952b553244c01bb9ac6 2023-11-12 00:56:12,152 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311123fdd982ad07d4c978fb8d882a1badd39 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311123fdd982ad07d4c978fb8d882a1badd39 2023-11-12 00:56:12,153 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311127b1d4acb7d484400b0e115b70b220ca4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311127b1d4acb7d484400b0e115b70b220ca4 2023-11-12 00:56:12,154 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231112c09d52939c2e4370b04685a943cf330e to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231112c09d52939c2e4370b04685a943cf330e 2023-11-12 00:56:12,154 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-12 00:56:12,154 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231112' 2023-11-12 00:56:12,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231112 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:12,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231112 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:12,721 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231112706d9bd1421440f7be555105dc134a04 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231112706d9bd1421440f7be555105dc134a04 2023-11-12 00:56:12,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:12,768 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231112/family1/bd520abb03db420dab7f0490a31688c8 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-12 00:56:12,769 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57., hostname=jenkins-hbase4.apache.org,43681,1699750400629, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231112/family1/bd520abb03db420dab7f0490a31688c8}] 2023-11-12 00:56:12,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(763): Validating hfile at hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231112/family1/bd520abb03db420dab7f0490a31688c8 for inclusion in 6f10f9ddb9807fd2fa78c148dd070a57/family1 2023-11-12 00:56:12,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-12 00:56:12,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(777): Region bounds: first= last=1 2023-11-12 00:56:12,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegion(2446): Flush status journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:56:12,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231112/family1/bd520abb03db420dab7f0490a31688c8 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__oj8co01oo1bd6lbqrupaouc9jsg9gkmubomch9uu1ao7f6kq0vp3l2fr7svpjn9p/family1/bd520abb03db420dab7f0490a31688c8 2023-11-12 00:56:12,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__oj8co01oo1bd6lbqrupaouc9jsg9gkmubomch9uu1ao7f6kq0vp3l2fr7svpjn9p/family1/bd520abb03db420dab7f0490a31688c8 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/3e72683b48c14b519cb6c61f2260d7c6_SeqId_28_ 2023-11-12 00:56:12,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(849): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__oj8co01oo1bd6lbqrupaouc9jsg9gkmubomch9uu1ao7f6kq0vp3l2fr7svpjn9p/family1/bd520abb03db420dab7f0490a31688c8 into 6f10f9ddb9807fd2fa78c148dd070a57/family1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/3e72683b48c14b519cb6c61f2260d7c6_SeqId_28_ - updating store file list. 2023-11-12 00:56:12,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(882): Loaded HFile hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/3e72683b48c14b519cb6c61f2260d7c6_SeqId_28_ into 6f10f9ddb9807fd2fa78c148dd070a57/family1 2023-11-12 00:56:12,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.HStore(855): Successfully loaded hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__oj8co01oo1bd6lbqrupaouc9jsg9gkmubomch9uu1ao7f6kq0vp3l2fr7svpjn9p/family1/bd520abb03db420dab7f0490a31688c8 into 6f10f9ddb9807fd2fa78c148dd070a57/family1 (new location: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/family1/3e72683b48c14b519cb6c61f2260d7c6_SeqId_28_) 2023-11-12 00:56:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43681] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/staging/jenkins__testMajorCompactionFromAdmin__oj8co01oo1bd6lbqrupaouc9jsg9gkmubomch9uu1ao7f6kq0vp3l2fr7svpjn9p/family1/bd520abb03db420dab7f0490a31688c8 2023-11-12 00:56:12,841 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231112 table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:12,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:12,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111208225672311a4bc0a1396b9bf2657230 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111208225672311a4bc0a1396b9bf2657230 2023-11-12 00:56:12,844 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311121bf83037907e44469c9489b384df07e4 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311121bf83037907e44469c9489b384df07e4 2023-11-12 00:56:12,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311121dfdbac7d19045a2a4f940cb6965af58 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311121dfdbac7d19045a2a4f940cb6965af58 2023-11-12 00:56:12,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311125cb8ba24103d4420b7833bad85432704 to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311125cb8ba24103d4420b7833bad85432704 2023-11-12 00:56:12,847 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-12 00:56:12,847 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231112' 2023-11-12 00:56:12,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231112 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:12,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-12 00:56:12,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-12 00:56:12,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del] 2023-11-12 00:56:12,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:12,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231112810bbae806b2411085184d24dd9e85c7_del 2023-11-12 00:56:12,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-12 00:56:12,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del] 2023-11-12 00:56:12,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:12,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231112a6deebcdc68c48238c38c114b216f209_del 2023-11-12 00:56:12,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-12 00:56:12,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del] 2023-11-12 00:56:12,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] backup.HFileArchiver(360): Archiving compacted files. 2023-11-12 00:56:12,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del to hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111285f759578e3848199e2b14244dc52dc3_del 2023-11-12 00:56:12,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-12 00:56:12,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1699750403628] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-12 00:56:12,854 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-12 00:56:12,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3870 sec 2023-11-12 00:56:12,872 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:56:12,875 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:56:12,878 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-12 00:56:12,879 DEBUG [Listener at localhost/40343] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-12 00:56:12,885 INFO [Listener at localhost/40343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-12 00:56:12,927 INFO [Listener at localhost/40343] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 256), OpenFileDescriptor=669 (was 675), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 135) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1108 (was 1159) 2023-11-12 00:56:12,927 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2131ff51 to 127.0.0.1:60532 2023-11-12 00:56:12,927 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:56:12,928 INFO [Listener at localhost/40343] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-12 00:56:12,928 INFO [Listener at localhost/40343] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-12 00:56:12,928 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f95205 to 127.0.0.1:60532 2023-11-12 00:56:12,928 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:56:12,929 DEBUG [Listener at localhost/40343] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-12 00:56:12,929 DEBUG [Listener at localhost/40343] util.JVMClusterUtil(257): Found active master hash=1859250806, stopped=false 2023-11-12 00:56:12,929 INFO [Listener at localhost/40343] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:56:12,931 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-12 00:56:12,931 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-12 00:56:12,932 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:56:12,932 INFO [Listener at localhost/40343] procedure2.ProcedureExecutor(628): Stopping 2023-11-12 00:56:12,932 DEBUG [Listener at localhost/40343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ba8a2cc to 127.0.0.1:60532 2023-11-12 00:56:12,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-12 00:56:12,932 DEBUG [Listener at localhost/40343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:56:12,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-12 00:56:12,932 INFO [Listener at localhost/40343] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43681,1699750400629' ***** 2023-11-12 00:56:12,932 INFO [Listener at localhost/40343] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HeapMemoryManager(220): Stopping 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-12 00:56:12,933 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 199528b795c555d406bc521af8b8efc2 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for e854e8483a90d8411db6a37134b33b63 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 3ca8350d46be6df0d4769861a6ebe5af 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 263a67b07df9665bc258d032dba0f4e6 2023-11-12 00:56:12,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 199528b795c555d406bc521af8b8efc2, disabling compactions & flushes 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 06e0eec5bf9ea0346eb6e2efb04818c0 2023-11-12 00:56:12,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:56:12,933 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 35029a0c0c81d223a4e45d489958cfeb 2023-11-12 00:56:12,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for e54322db166e4083ab73da40eb699d45 2023-11-12 00:56:12,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. after waiting 0 ms 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for ec395e4117e03f35cc9abdba56a76116 2023-11-12 00:56:12,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 247448b82bf56bb9cbb3264a90f27243 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 53ac21fc7483c88726dff14e6d6ac168 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 9743d1cdc651fb2d06c421fbd8ca056c 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 30776669ce9a16f9418734b4c50a772b 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for d365b140a0de7324ebb5ec50ebb65fe1 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 102e79e9eb9e2fd338dca31ed883a20f 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 6f10f9ddb9807fd2fa78c148dd070a57 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 5f718172b15982a24b524747297f2bf3 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for a42ba8bcf7a2d17d2a9e3b6bc8cc432e 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for b0b9775d0ec55d580d7732f12aa5fda9 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 449920aa5f626fab14ce2ff9d43e75d0 2023-11-12 00:56:12,934 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:12,934 DEBUG [RS:0;jenkins-hbase4:43681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d0e1bbd to 127.0.0.1:60532 2023-11-12 00:56:12,934 DEBUG [RS:0;jenkins-hbase4:43681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:56:12,935 INFO [RS:0;jenkins-hbase4:43681] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-12 00:56:12,935 INFO [RS:0;jenkins-hbase4:43681] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-12 00:56:12,935 INFO [RS:0;jenkins-hbase4:43681] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-12 00:56:12,935 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-12 00:56:12,935 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-12 00:56:12,935 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-12 00:56:12,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-12 00:56:12,936 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-12 00:56:12,936 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-12 00:56:12,936 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-12 00:56:12,936 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-12 00:56:12,936 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1504): Waiting on 06e0eec5bf9ea0346eb6e2efb04818c0, 102e79e9eb9e2fd338dca31ed883a20f, 1588230740, 199528b795c555d406bc521af8b8efc2, 247448b82bf56bb9cbb3264a90f27243, 263a67b07df9665bc258d032dba0f4e6, 30776669ce9a16f9418734b4c50a772b, 35029a0c0c81d223a4e45d489958cfeb, 3ca8350d46be6df0d4769861a6ebe5af, 449920aa5f626fab14ce2ff9d43e75d0, 53ac21fc7483c88726dff14e6d6ac168, 5f718172b15982a24b524747297f2bf3, 6f10f9ddb9807fd2fa78c148dd070a57, 9743d1cdc651fb2d06c421fbd8ca056c, a42ba8bcf7a2d17d2a9e3b6bc8cc432e, b0b9775d0ec55d580d7732f12aa5fda9, d365b140a0de7324ebb5ec50ebb65fe1, e54322db166e4083ab73da40eb699d45, e854e8483a90d8411db6a37134b33b63, ec395e4117e03f35cc9abdba56a76116, f5fa06a119e39fd446618c4b02243a41 2023-11-12 00:56:12,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithWeeklyPolicy/199528b795c555d406bc521af8b8efc2/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-12 00:56:12,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:56:12,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 199528b795c555d406bc521af8b8efc2: 2023-11-12 00:56:12,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699750431882.199528b795c555d406bc521af8b8efc2. 2023-11-12 00:56:12,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e854e8483a90d8411db6a37134b33b63, disabling compactions & flushes 2023-11-12 00:56:12,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:56:12,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:56:12,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. after waiting 0 ms 2023-11-12 00:56:12,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:56:12,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/e854e8483a90d8411db6a37134b33b63/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-12 00:56:12,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:56:12,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e854e8483a90d8411db6a37134b33b63: 2023-11-12 00:56:12,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699750445609.e854e8483a90d8411db6a37134b33b63. 2023-11-12 00:56:12,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3ca8350d46be6df0d4769861a6ebe5af, disabling compactions & flushes 2023-11-12 00:56:12,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:56:12,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:56:12,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. after waiting 0 ms 2023-11-12 00:56:12,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:56:12,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3ca8350d46be6df0d4769861a6ebe5af 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-12 00:56:12,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/.tmp/info/04e2fb7901994e4bbf7ff345aa069bba 2023-11-12 00:56:12,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04e2fb7901994e4bbf7ff345aa069bba 2023-11-12 00:56:12,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/.tmp/info/f94db4d08e224ef7adbaa9cd4c358596 2023-11-12 00:56:12,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/.tmp/info/f94db4d08e224ef7adbaa9cd4c358596 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/info/f94db4d08e224ef7adbaa9cd4c358596 2023-11-12 00:56:12,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/info/f94db4d08e224ef7adbaa9cd4c358596, entries=3, sequenceid=7, filesize=4.8 K 2023-11-12 00:56:12,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/.tmp/rep_barrier/0a0257ebf0844323a69382b050b14d66 2023-11-12 00:56:12,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 3ca8350d46be6df0d4769861a6ebe5af in 15ms, sequenceid=7, compaction requested=false 2023-11-12 00:56:12,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a0257ebf0844323a69382b050b14d66 2023-11-12 00:56:12,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/namespace/3ca8350d46be6df0d4769861a6ebe5af/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-12 00:56:12,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:56:12,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3ca8350d46be6df0d4769861a6ebe5af: 2023-11-12 00:56:12,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699750402895.3ca8350d46be6df0d4769861a6ebe5af. 2023-11-12 00:56:12,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 263a67b07df9665bc258d032dba0f4e6, disabling compactions & flushes 2023-11-12 00:56:12,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:56:12,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:56:12,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. after waiting 0 ms 2023-11-12 00:56:12,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:56:12,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithMonthlyPolicy/263a67b07df9665bc258d032dba0f4e6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-12 00:56:12,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:56:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 263a67b07df9665bc258d032dba0f4e6: 2023-11-12 00:56:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699750418407.263a67b07df9665bc258d032dba0f4e6. 2023-11-12 00:56:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 06e0eec5bf9ea0346eb6e2efb04818c0, disabling compactions & flushes 2023-11-12 00:56:12,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:56:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:56:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. after waiting 0 ms 2023-11-12 00:56:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:56:12,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/06e0eec5bf9ea0346eb6e2efb04818c0/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-12 00:56:12,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:56:12,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 06e0eec5bf9ea0346eb6e2efb04818c0: 2023-11-12 00:56:12,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699750521690.06e0eec5bf9ea0346eb6e2efb04818c0. 2023-11-12 00:56:12,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 35029a0c0c81d223a4e45d489958cfeb, disabling compactions & flushes 2023-11-12 00:56:12,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:56:12,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:56:12,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. after waiting 0 ms 2023-11-12 00:56:12,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:56:12,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/35029a0c0c81d223a4e45d489958cfeb/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-12 00:56:12,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:56:12,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 35029a0c0c81d223a4e45d489958cfeb: 2023-11-12 00:56:12,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699750403805.35029a0c0c81d223a4e45d489958cfeb. 2023-11-12 00:56:12,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e54322db166e4083ab73da40eb699d45, disabling compactions & flushes 2023-11-12 00:56:12,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:56:12,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:56:12,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. after waiting 0 ms 2023-11-12 00:56:12,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:56:12,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyPolicy/e54322db166e4083ab73da40eb699d45/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-12 00:56:12,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:56:12,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e54322db166e4083ab73da40eb699d45: 2023-11-12 00:56:12,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699750450599.e54322db166e4083ab73da40eb699d45. 2023-11-12 00:56:12,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec395e4117e03f35cc9abdba56a76116, disabling compactions & flushes 2023-11-12 00:56:12,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:56:12,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:56:12,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. after waiting 0 ms 2023-11-12 00:56:12,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:56:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/ec395e4117e03f35cc9abdba56a76116/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-12 00:56:12,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:56:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec395e4117e03f35cc9abdba56a76116: 2023-11-12 00:56:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699750445609.ec395e4117e03f35cc9abdba56a76116. 2023-11-12 00:56:12,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 247448b82bf56bb9cbb3264a90f27243, disabling compactions & flushes 2023-11-12 00:56:12,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:56:12,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:56:12,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. after waiting 0 ms 2023-11-12 00:56:12,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:56:12,985 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testScannerOnBulkLoadRefHFiles/247448b82bf56bb9cbb3264a90f27243/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-12 00:56:12,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 247448b82bf56bb9cbb3264a90f27243: 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699750445609.247448b82bf56bb9cbb3264a90f27243. 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 53ac21fc7483c88726dff14e6d6ac168, disabling compactions & flushes 2023-11-12 00:56:12,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. after waiting 0 ms 2023-11-12 00:56:12,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:56:12,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/53ac21fc7483c88726dff14e6d6ac168/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-12 00:56:12,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:56:12,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 53ac21fc7483c88726dff14e6d6ac168: 2023-11-12 00:56:12,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699750478466.53ac21fc7483c88726dff14e6d6ac168. 2023-11-12 00:56:12,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9743d1cdc651fb2d06c421fbd8ca056c, disabling compactions & flushes 2023-11-12 00:56:12,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:56:12,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:56:12,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. after waiting 0 ms 2023-11-12 00:56:12,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:56:12,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/9743d1cdc651fb2d06c421fbd8ca056c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-12 00:56:12,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:56:12,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9743d1cdc651fb2d06c421fbd8ca056c: 2023-11-12 00:56:12,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699750521690.9743d1cdc651fb2d06c421fbd8ca056c. 2023-11-12 00:56:12,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30776669ce9a16f9418734b4c50a772b, disabling compactions & flushes 2023-11-12 00:56:12,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:56:12,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:56:12,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. after waiting 0 ms 2023-11-12 00:56:12,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:56:12,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/30776669ce9a16f9418734b4c50a772b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-12 00:56:12,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:56:12,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30776669ce9a16f9418734b4c50a772b: 2023-11-12 00:56:12,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699750500829.30776669ce9a16f9418734b4c50a772b. 2023-11-12 00:56:12,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d365b140a0de7324ebb5ec50ebb65fe1, disabling compactions & flushes 2023-11-12 00:56:12,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:56:12,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:56:12,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. after waiting 0 ms 2023-11-12 00:56:12,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:56:12,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d365b140a0de7324ebb5ec50ebb65fe1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-12 00:56:13,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:56:13,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d365b140a0de7324ebb5ec50ebb65fe1: 2023-11-12 00:56:13,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699750463824.d365b140a0de7324ebb5ec50ebb65fe1. 2023-11-12 00:56:13,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f5fa06a119e39fd446618c4b02243a41, disabling compactions & flushes 2023-11-12 00:56:13,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:56:13,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:56:13,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. after waiting 0 ms 2023-11-12 00:56:13,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:56:13,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMinorCompactionWithMonthlyPolicy/f5fa06a119e39fd446618c4b02243a41/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-12 00:56:13,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:56:13,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f5fa06a119e39fd446618c4b02243a41: 2023-11-12 00:56:13,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699750540858.f5fa06a119e39fd446618c4b02243a41. 2023-11-12 00:56:13,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 102e79e9eb9e2fd338dca31ed883a20f, disabling compactions & flushes 2023-11-12 00:56:13,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:56:13,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:56:13,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. after waiting 0 ms 2023-11-12 00:56:13,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/102e79e9eb9e2fd338dca31ed883a20f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-12 00:56:13,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 102e79e9eb9e2fd338dca31ed883a20f: 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699750500829.102e79e9eb9e2fd338dca31ed883a20f. 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f10f9ddb9807fd2fa78c148dd070a57, disabling compactions & flushes 2023-11-12 00:56:13,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. after waiting 0 ms 2023-11-12 00:56:13,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/6f10f9ddb9807fd2fa78c148dd070a57/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-12 00:56:13,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f10f9ddb9807fd2fa78c148dd070a57: 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699750553687.6f10f9ddb9807fd2fa78c148dd070a57. 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f718172b15982a24b524747297f2bf3, disabling compactions & flushes 2023-11-12 00:56:13,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. after waiting 0 ms 2023-11-12 00:56:13,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testCompactionWithHFileLink/5f718172b15982a24b524747297f2bf3/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-12 00:56:13,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f718172b15982a24b524747297f2bf3: 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699750500829.5f718172b15982a24b524747297f2bf3. 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a42ba8bcf7a2d17d2a9e3b6bc8cc432e, disabling compactions & flushes 2023-11-12 00:56:13,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. after waiting 0 ms 2023-11-12 00:56:13,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/a42ba8bcf7a2d17d2a9e3b6bc8cc432e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-12 00:56:13,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a42ba8bcf7a2d17d2a9e3b6bc8cc432e: 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699750553687.a42ba8bcf7a2d17d2a9e3b6bc8cc432e. 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b0b9775d0ec55d580d7732f12aa5fda9, disabling compactions & flushes 2023-11-12 00:56:13,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. after waiting 0 ms 2023-11-12 00:56:13,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:13,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/default/testMajorCompactionFromAdmin/b0b9775d0ec55d580d7732f12aa5fda9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-12 00:56:13,020 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:13,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b0b9775d0ec55d580d7732f12aa5fda9: 2023-11-12 00:56:13,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699750553687.b0b9775d0ec55d580d7732f12aa5fda9. 2023-11-12 00:56:13,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 449920aa5f626fab14ce2ff9d43e75d0, disabling compactions & flushes 2023-11-12 00:56:13,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:56:13,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:56:13,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. after waiting 0 ms 2023-11-12 00:56:13,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:56:13,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/ns/testMinorCompaction/449920aa5f626fab14ce2ff9d43e75d0/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-12 00:56:13,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:56:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 449920aa5f626fab14ce2ff9d43e75d0: 2023-11-12 00:56:13,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699750521690.449920aa5f626fab14ce2ff9d43e75d0. 2023-11-12 00:56:13,028 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-12 00:56:13,136 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-12 00:56:13,337 DEBUG [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-12 00:56:13,361 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-12 00:56:13,361 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-12 00:56:13,369 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/.tmp/table/065a10f379e246d5b95fb309e7ad1a41 2023-11-12 00:56:13,373 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 065a10f379e246d5b95fb309e7ad1a41 2023-11-12 00:56:13,374 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/.tmp/info/04e2fb7901994e4bbf7ff345aa069bba as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/info/04e2fb7901994e4bbf7ff345aa069bba 2023-11-12 00:56:13,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04e2fb7901994e4bbf7ff345aa069bba 2023-11-12 00:56:13,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/info/04e2fb7901994e4bbf7ff345aa069bba, entries=226, sequenceid=130, filesize=37.9 K 2023-11-12 00:56:13,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/.tmp/rep_barrier/0a0257ebf0844323a69382b050b14d66 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/rep_barrier/0a0257ebf0844323a69382b050b14d66 2023-11-12 00:56:13,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a0257ebf0844323a69382b050b14d66 2023-11-12 00:56:13,381 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/rep_barrier/0a0257ebf0844323a69382b050b14d66, entries=1, sequenceid=130, filesize=5.0 K 2023-11-12 00:56:13,382 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/.tmp/table/065a10f379e246d5b95fb309e7ad1a41 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/table/065a10f379e246d5b95fb309e7ad1a41 2023-11-12 00:56:13,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 065a10f379e246d5b95fb309e7ad1a41 2023-11-12 00:56:13,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/table/065a10f379e246d5b95fb309e7ad1a41, entries=27, sequenceid=130, filesize=6.6 K 2023-11-12 00:56:13,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 451ms, sequenceid=130, compaction requested=false 2023-11-12 00:56:13,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-12 00:56:13,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-12 00:56:13,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-12 00:56:13,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-12 00:56:13,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-12 00:56:13,537 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43681,1699750400629; all regions closed. 2023-11-12 00:56:13,544 DEBUG [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/oldWALs 2023-11-12 00:56:13,544 INFO [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43681%2C1699750400629.meta:.meta(num 1699750402632) 2023-11-12 00:56:13,548 DEBUG [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/oldWALs 2023-11-12 00:56:13,548 INFO [RS:0;jenkins-hbase4:43681] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43681%2C1699750400629:(num 1699750402527) 2023-11-12 00:56:13,548 DEBUG [RS:0;jenkins-hbase4:43681] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:56:13,548 INFO [RS:0;jenkins-hbase4:43681] regionserver.LeaseManager(133): Closed leases 2023-11-12 00:56:13,548 INFO [RS:0;jenkins-hbase4:43681] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-12 00:56:13,549 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-12 00:56:13,549 INFO [RS:0;jenkins-hbase4:43681] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43681 2023-11-12 00:56:13,557 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43681,1699750400629 2023-11-12 00:56:13,557 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-12 00:56:13,557 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-12 00:56:13,558 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43681,1699750400629] 2023-11-12 00:56:13,559 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43681,1699750400629; numProcessing=1 2023-11-12 00:56:13,560 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43681,1699750400629 already deleted, retry=false 2023-11-12 00:56:13,560 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,43681,1699750400629 expired; onlineServers=0 2023-11-12 00:56:13,560 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41743,1699750399446' ***** 2023-11-12 00:56:13,560 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-12 00:56:13,561 DEBUG [M:0;jenkins-hbase4:41743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fece04d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-12 00:56:13,561 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41743,1699750399446 2023-11-12 00:56:13,561 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41743,1699750399446; all regions closed. 2023-11-12 00:56:13,561 DEBUG [M:0;jenkins-hbase4:41743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-12 00:56:13,561 DEBUG [M:0;jenkins-hbase4:41743] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-12 00:56:13,561 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-12 00:56:13,561 DEBUG [M:0;jenkins-hbase4:41743] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-12 00:56:13,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699750402157] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1699750402157,5,FailOnTimeoutGroup] 2023-11-12 00:56:13,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699750402157] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1699750402157,5,FailOnTimeoutGroup] 2023-11-12 00:56:13,561 INFO [M:0;jenkins-hbase4:41743] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-12 00:56:13,561 INFO [M:0;jenkins-hbase4:41743] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-12 00:56:13,561 INFO [M:0;jenkins-hbase4:41743] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-12 00:56:13,562 DEBUG [M:0;jenkins-hbase4:41743] master.HMaster(1512): Stopping service threads 2023-11-12 00:56:13,562 INFO [M:0;jenkins-hbase4:41743] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-12 00:56:13,562 ERROR [M:0;jenkins-hbase4:41743] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-12 00:56:13,563 INFO [M:0;jenkins-hbase4:41743] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-12 00:56:13,563 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-12 00:56:13,563 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-12 00:56:13,563 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-12 00:56:13,564 DEBUG [M:0;jenkins-hbase4:41743] zookeeper.ZKUtil(398): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-12 00:56:13,564 WARN [M:0;jenkins-hbase4:41743] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-12 00:56:13,564 INFO [M:0;jenkins-hbase4:41743] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-12 00:56:13,564 INFO [M:0;jenkins-hbase4:41743] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-12 00:56:13,564 DEBUG [M:0;jenkins-hbase4:41743] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-12 00:56:13,564 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:56:13,564 DEBUG [M:0;jenkins-hbase4:41743] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:56:13,564 DEBUG [M:0;jenkins-hbase4:41743] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-12 00:56:13,564 DEBUG [M:0;jenkins-hbase4:41743] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:56:13,564 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.73 KB heapSize=598.51 KB 2023-11-12 00:56:13,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-12 00:56:13,573 INFO [M:0;jenkins-hbase4:41743] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.73 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/791ccd84b03947dba2ae07acce4ef8c1 2023-11-12 00:56:13,576 INFO [M:0;jenkins-hbase4:41743] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 791ccd84b03947dba2ae07acce4ef8c1 2023-11-12 00:56:13,577 DEBUG [M:0;jenkins-hbase4:41743] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/791ccd84b03947dba2ae07acce4ef8c1 as hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/791ccd84b03947dba2ae07acce4ef8c1 2023-11-12 00:56:13,579 INFO [M:0;jenkins-hbase4:41743] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 791ccd84b03947dba2ae07acce4ef8c1 2023-11-12 00:56:13,580 INFO [M:0;jenkins-hbase4:41743] regionserver.HStore(1080): Added hdfs://localhost:46713/user/jenkins/test-data/34594c8c-8606-f571-5eca-600a481319a2/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/791ccd84b03947dba2ae07acce4ef8c1, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-12 00:56:13,580 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegion(2948): Finished flush of dataSize ~512.73 KB/525037, heapSize ~598.49 KB/612856, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=1006, compaction requested=false 2023-11-12 00:56:13,581 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-12 00:56:13,581 DEBUG [M:0;jenkins-hbase4:41743] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-12 00:56:13,583 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-12 00:56:13,583 INFO [M:0;jenkins-hbase4:41743] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-12 00:56:13,584 INFO [M:0;jenkins-hbase4:41743] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41743 2023-11-12 00:56:13,586 DEBUG [M:0;jenkins-hbase4:41743] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41743,1699750399446 already deleted, retry=false 2023-11-12 00:56:13,659 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-12 00:56:13,659 INFO [RS:0;jenkins-hbase4:43681] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43681,1699750400629; zookeeper connection closed. 2023-11-12 00:56:13,659 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): regionserver:43681-0x101d7c402010001, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-12 00:56:13,659 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a87efcc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a87efcc 2023-11-12 00:56:13,659 INFO [Listener at localhost/40343] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-12 00:56:13,687 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-12 00:56:13,687 INFO [M:0;jenkins-hbase4:41743] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41743,1699750399446; zookeeper connection closed. 2023-11-12 00:56:13,688 DEBUG [Listener at localhost/40343-EventThread] zookeeper.ZKWatcher(600): master:41743-0x101d7c402010000, quorum=127.0.0.1:60532, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-12 00:56:13,689 WARN [Listener at localhost/40343] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-12 00:56:13,692 INFO [Listener at localhost/40343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-12 00:56:13,800 WARN [BP-929283160-172.31.14.131-1699750396122 heartbeating to localhost/127.0.0.1:46713] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-12 00:56:13,800 WARN [BP-929283160-172.31.14.131-1699750396122 heartbeating to localhost/127.0.0.1:46713] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-929283160-172.31.14.131-1699750396122 (Datanode Uuid c59e51a0-f0f3-499f-bf73-1f56e5d89255) service to localhost/127.0.0.1:46713 2023-11-12 00:56:13,802 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/dfs/data/data1/current/BP-929283160-172.31.14.131-1699750396122] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-12 00:56:13,802 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5793ec72-cf46-c753-1d60-9476440712db/cluster_f9ddf974-c4ae-3090-8988-6a99fa87e620/dfs/data/data2/current/BP-929283160-172.31.14.131-1699750396122] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-12 00:56:13,828 INFO [Listener at localhost/40343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-12 00:56:13,965 INFO [Listener at localhost/40343] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-12 00:56:14,044 INFO [Listener at localhost/40343] hbase.HBaseTestingUtility(1293): Minicluster is down